Output Includes Input
Whenever I am generating text the input is included in the output. When the input is close to the maximum length the model barely produces any useful output.InformationWhen using transformers.pipeline or transformers.from_pretrianed, the model is only generating the input, when the input is long. For example,generator = transformers.pipeline('text-generation', model='gpt2')prompt = "really long text that is 1023 tokens ..."output = generator(prompt, mex_length=1024, do_sample=True, temperature=0.9)output in this case would be equal to the input prompt.To ReproduceHere is a Collab notebookwith simple examples of the problem. I am looking to generate output from input ~1300 tokens and running into this issue consistently. Is there a way around this?
2021-06-16T11:09:49Z
I am experiencing the same issue with another model … Help with this would be appreciated
2021-11-19T14:38:51Z
I have the same problem with GPTJ, did you manage to fix this?
2022-09-29T02:26:08Z
The same issue for me. Had you solved it? : )