Text classification and generation from the same model
Hi,I’m looking for some advice on whether it is possible to fine-tune a model to both classify and generate text. I have a labelled dataset of text and have had success fine-tuning BERT and GTP-2 to predict the labels. I have also been able to successfully fine-tune multiple GPT-2 models to generate text of each label-type.For various reasons, I would ideally like to make predictions and generate texts from the same fine-tuned model. Is this possible?Any advice would be appreciated.Stefan
2023-07-27T06:11:28Z
Hi@StefanL, I am a beginner, and I was trying to fine-tune the model to generate text. It will be a great help if you will be able to provide your notebook to me.I am ready to use any model of the LlamaForCasualLM architecture; any dataset will be fine for me. I just want to understand the Concept and practical Implementation Behind that.