PRO Plan and for running huge models on free inference api?
Hi,I was curious about whether the pro plan would enable me to do the following:curlhttps://api-inference.huggingface.co/models/HuggingFaceH4/starchat-alpha-X POST-d ‘{“inputs”: "Can you please let us know more details about your "}’-H “Authorization: Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx”As I am currently getting{“error”:"The model HuggingFaceH4/starchat-alpha is too large to be loaded automatically (31GB > 10GB)…}Best,Jean Elbers
2023-05-15T17:34:01Z
hi@jelber2,This is a really large model, you may need a dedicated hardware , I recommend you looking at ourInference Endpoints - Hugging Faceservice and reaching out if you need help, thanks