Dropout for Marian MT models?
I’m finetuning a Marian mt model for a translation task, and I want to use dropout to avoid overfitting, but I cant figure out how to do it. Does anyone know how to do it?
2023-03-01T17:14:47Z
Hey@TheaMTYou should be able to control dropout through the configuration file – seehere.Please note that it has to be defined at model initialization time! If you’re usingfrom_pretrained, you can pass the (modified) configuration as an input – seehereI hope this helps