Fine tuning the existing fine tuned model
Is it possible for fine tuning the already fine tuned model without losing previous features??Suppose i fine-tune a model on “squad” dataset then I want to Incremental fine-tune the same model on some other dataset havingsame/different data formate and hyperparameters,does this means now model isfine-tuned on 2 datasets??? or it forgets the “squad” dataset when I fine tune on the second dataset.Please acknowledge me over this@sgugger@amyeroberts
2024-07-18T10:31:26Z
Hey did you get any update on this? I was looking into a similar problem…