Enhance a MarianMT pretrained model from HuggingFace with more training data
I am using a pretrained MarianMT machine translation model fromEnglish to German. I also have a large set of high quality English-to-German sentence pairs that I would like to use to enhance the performance of the model, which is trained on the OPUS corpus, butwithoutmaking the modelforgetthe OPUS training data. Is there a way to do that? Thanks.Also onStackOverflow
2020-09-07T12:11:06Z
You could further fine-tune it on your own corpus, and I think if you have a high quality dataset then it should improve the results after fine-tuning.You can use thefinetune.pyscript fromherefor fine-tuning marian
2020-11-18T14:52:22Z
If forgetting does turn out to be a problem, you could do your fine-tuning with a mixture of your new data and the OPUS data.
2021-05-29T08:52:14Z
Sorry can you re-share the link, the link doesn’t work
2021-05-29T08:57:23Z
Hereit is.