Change length of GPT-neo output
Any way to modify the length of the output text generated by the GPT-neo inference API?
2021-05-21T19:32:34Z
Does anyone know a solution for this?
2021-05-22T07:57:47Z
afraine:e output text generated by the GPT-neo inference AI am also interested in this
2021-05-22T21:44:39Z
Hi! You just need to modify the “max_length” parameter in your Json body, when requesting via API.
2021-05-23T08:04:20Z
I know that, but how do you go beyond 500 tokens?
2021-05-25T10:13:08Z
As far as I know, the max output through API is 256 tokens (~200 words).
2021-06-10T15:09:17Z
Change max_length:res = generator(prompt, max_length=70, do_sample=True, temperature=0.9)