Possible encoder decoder models
Hi huggingface team,Is there a list of compatible models that work with theEncoderDecodermodel?For instance the docs mentionBERTEncoder/Decoder and I think@patrickvonplatenhas written some beautiful notebooks usingRoBERTa, but can it be used for models like theReformerorALBERT? in other words, is something like below possible?config_encoder = AlbertConfig()
config_decoder = AlbertConfig()

config = EncoderDecoderConfig.from_encoder_decoder_configs(config_encoder, config_decoder)