Changing a CML Language
Hi all!I just wanted to know if is there any shortcut for changing acausal language modellanguage (in my case from English to Persian) - like fine-tuning a existing one - or I should train one from scratch?
2021-11-09T11:27:41Z
You can start from a pre-trained English one and fine-tune it on another language. The effectiveness of this has been shown (among others) in the paperAs Good as New. How to Successfully Recycle English GPT-2 to Make Models for Other Languages.cc@wietsedv, who is the main author of that paper.