Turn a classification model into seq2seq model?
Hey everyone, I havent seen a similar question, so I am shooting my shot.I would like to use transfer learning with a domain specific model. However, the most promising model does not support the AutoModelForSeq2Seq. Can I somehow still implement it as Seq2Seq model (e.g. by putting extra layers on top) or am I missing a critical architectural feature that would be needed to turn the model into an autoregressive seq2seq model?I want to work withsnowood1/ConfliBERT-scr-uncased · Hugging Face
2022-12-11T09:41:44Z
Solved by using the EncoderDecoderModel.