Inference API down?
While accessing this(speechbrain/lang-id-voxlingua107-ecapa · Hugging Face) model via Inference API, I am getting the following error -(MaxRetryError(‘HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/speechbrain/lang-id-voxlingua107-ecapa (Caused by NameResolutionError(“<urllib3.connection.HTTPSConnection object at 0x7f5306290cd0>: Failed to resolve 'huggingface.co' ([Errno -3] Temporary failure in name resolution)”))’), ‘(Request ID: d978f641-257c-45c4-b95b-c51865344dfe)’)Can someone provide more insight into this error? And how do we solve it?
2024-06-03T08:28:14Z
I’m also facing issues with Inference API all of a sudden
2024-06-03T10:03:26Z
same here.
2024-06-03T10:23:18Z
We are also facing issues with the Inference Endpoints
2024-06-03T10:29:23Z
Same for hours.
2024-06-03T11:06:24Z
Thanks for reporting, issue should be fixed now.
2024-06-03T11:09:12Z
Fixed. Thank you.
2024-06-03T14:33:44Z
@nielsrDoes fixed mean that it is now a 500 internal server error? I am currently facing this error with all 3 providers and multiple models.
2024-06-04T08:14:38Z
@nielsrI have debugged the problem further. The endpoints work as long as they are public. Both with and without scale to zero. If I secure the endpoint and request it without a token, a 401 is returned. So far so good. But if I pass a valid token, I get a 500. Do your integration tests work?
2024-06-04T11:43:09Z
@nielsrOk. This is really weird now. For 2 hours I got 401 from the UI creating new endpoints and deleting existing ones (which costed me 12$) or even showing existing instances. Now the instance is visible again. And the Endpoint ist working with toking. So I got a last question: Are you fixing things in production without customer feedback and what kind of availability and stability can I expect from dedicated endpoints? Are they ready for production (>99,9% availability)?
2024-06-04T18:10:44Z
Hi,Yes they should be ready for production (they aim to make putting ML models in production easier with a few clicks). I appreciate your feedback, I’m not part of the Inference Endpoints team but will forward your feedback to them.
2024-06-08T00:12:15Z
The APIs for the evaluate library are also down for five days.
2024-06-08T00:12:48Z
Just go here and see the runtime errors:evaluate-metric (Evaluate Metric)