Seq2Seq model for distilgpt2
Hello everybody,I want to do a summarization task (like hereSummarization), but I want to use “distilgpt2” instead of “t5-small”. When replacing “t5-small” with “distilgpt2”, I get the following error:ValueError: Unrecognized configuration class <class ‘transformers.models.gpt2.configuration_gpt2.GPT2Config’> for this kind of AutoModel: AutoModelForSeq2SeqLM.Model type should be one of BartConfig, BigBirdPegasusConfig, BlenderbotConfig, BlenderbotSmallConfig, EncoderDecoderConfig, FSMTConfig, LEDConfig, LongT5Config, M2M100Config, MarianConfig, MBartConfig, MT5Config, PegasusConfig, PLBartConfig, ProphetNetConfig, T5Config, XLMProphetNetConfig.My interpretation is, that there is no model for “distilgpt2” for seq2seq tasks. Is that the case or did I miss something?Assuming there is no model I can use, do I have to do something like this:Paperspace Blog – 11 Aug 20Generating Text Summaries Using GPT-2 on PyTorch | Paperspace BlogIn this article I will discuss an efficient abstractive text summarization approach using GPT-2 on PyTorch with the CNN/Daily Mail dataset.Or is there an easier way to do it?Thanks in advance