How to use Inference API (serverless) in my model page?
Hi All.I have uploaded my fine-tuned model to Hugging Face. I want to create an inference API (serverless) on the model page, but a timeout occurs. What should I do?Here is how I wrote the README:pipeline_tag: text-generationinference:parameters:max_new_tokens: 300stop:- <|end_of_text|>- <|eot_id|>image754×496 19.5 KB
2024-06-28T05:53:29Z
I am having a similar problem