Pegasus Summarization API_Inference
Loving this model, and if we can use the API we’re happy to do so.  Using Pegasus summarization for some testing.human-centered-summarization/financial-summarization-pegasus · Hugging FaceHowever, there seem to be no options to pass via POST to determine a minimum and maximum length, which renders this endpoint useless.Am I missing something here?  Thanks, happy to be a new subscriber.
2021-05-04T15:51:13Z
Hi@induveca,Why would you say the endpoint is useless without being able to specifymin_lengthandmax_length? Models are conditioned to summarize, so the output should work.Anyway, you can still specifymin_lengthandmax_lengtheven if these arguments are not documented (they are not documented which means behavior is subject to change in the future).  They are specified in tokens length, which is really hard to gauge if you are only handling text.If you are using those, expect that the output might be cut mid sentence as you are basically forcing the model to stop outputting tokens even if it had still tokens to say.Cheers,Nicolas
2021-05-04T16:43:25Z
It has a maximum length of 32 tokens for a financial model.  When inputting an earnings call that will never be enough.So it is useless for any financial document without that ability to tweak.Are there other parameters we can use other than min_length and max_length?  Thanks for the help.
2021-05-05T13:18:10Z
Any ideas here?  I can just download and host it myself, but I do love the api-inference.  Not seeing any parameter options on the api-inference demo.  Assume this is a mistake, as it’s your profit driver and happy to pay/upgrade to a much larger plan if I can get it working correctly via api-inference.Thanks much for the awesome resource/community.
2021-05-28T09:45:34Z
@induvecaave you been able to solve this?