Difference between text-generation and text2text? Canonical way to provide multiple demonstrations?
I have a sequence of demonstrations:first demo => first output
second demo => second output
...
nth demo => nth outputGiven an+1th demo, I want the model to generate a candidate for then+1th output.Should I format this into a giant list separated by'\n', and append'=>'at the end to get this result? This is what I would do in the OpenAI Playground.What’s the appropriate pipeline to use for this task? Is ittext-generation,text2text, or something else? All data (both demos and outputs) is plaintext (ASCII). I’m currently aiming forgpt2-medium, which I will later probably have to fine-tune.GPT3 (text-davinci-002 on OpenAI Playground) can do this task without fine-tuning, but I have my doubts about GPT2.
2024-01-25T12:51:39Z
@yannbaneshouldn’t it be a text-generation task? You are trying to generate a new text give your input. Seeherefor my reasoning