Request: Mask-LM Training Google Colab
Does anyone have a Google Colab notebook they can share? (If possible, one that has been adapted to the new model upload)
2020-11-19T03:57:00Z
Hi, not exactly what you requested (ie. not the latest Huggingface version),but it should give the main idea with a bonus on working with TPU:Kaggle notebook onimplementation of MLM finetuning on TPUs with a custom training loop in TensorFlow 2.https://www.kaggle.com/riblidezso/finetune-xlm-roberta-on-jigsaw-test-data-with-mlm
2020-11-20T02:10:47Z
Thank you!