Serverless Inference API Token Limits/Settings
Hi,As written in Topic Title :My request :Where can i found information about the Token limits/Settings using Free Serverless Inference API ?Context :Trying automation for testing purposes fromMake.comwith HF_Models the responses generated by the models are Incomplete/truncatedMaybe there are some limits or Maybe there are some settings to do inMakemodule : HTTP : make an API Key AUTH RequestNB : My knowledge is lowNB: Before opening the request I consulted the links below without finding an answer.https://huggingface.co/docs/api-inference/rate-limitshttps://discuss.huggingface.co/search?q=API%20limit%20tokenAny Help Welcome.Thank You.
2024-11-26T20:14:46Z
For the record:Useful documentation :https://huggingface.co/docs/api-inference/tasks/text-generation?code=js#api-specificationhttps://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1?inference_api=trueIt would appear that there is a default limit of 500 tokens.I still have to figure out how to send the ‘max_new_tokens’ parameter at the same time as my request from a Make module.I am continuing my research onhttps://community.make.com/c/how-to/66regards
2024-11-27T08:14:55Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.