Load original T5 checkpoints
I want to load one of the original T5 checkpoints. How can I do that? I found an answer referring to aconvert_t5_original_tf_checkpoint_to_pytorch.pywhich does not seem to exist.
2021-02-17T10:03:19Z
…they are moved totransformers/src/transformers/models/t5. But it requires aconfig.jsonwhich is not part of the original files (ings://t5-data/pretrained_models/small).
2021-02-17T10:31:47Z
…and the solution: here you can find all related files (most importantlyconfig.jsonbut also already converted model files, model card, etc.):t5-small · Hugging Face. And an example workflow:mkdir t5
gsutil -m cp -r gs://t5-data/pretrained_models/small t5
python ~/transformers/src/transformers/models/t5/convert_t5_original_tf_checkpoint_to_pytorch.py --tf_checkpoint_path t5/small/model.ckpt-1000000 --pytorch_dump_path t5-small-pt --config_file t5/small_config.json