Custom model.generate() parameters for hosted models
Is it possible for a hosted model on huggingface to take in additional parameters via API?For example in python I can do something likemodel.generate(**inputs,num_return_sequences=10,top_k=50,length_penalty=0.3)But in the REST API I only see the ability to pass the inputs in, any suggestions?