Does the model learn from the eval_dataset when fine-tuning?
Hi,I have been fine-tuning the BART (BartForConditionalGeneration) model for summarization in a specific case, and I was wondering if the model also gets trained on the eval_dataset, or only on the train_dataset. In other words, if I test the model afterwards, can I still use the eval_dataset for testing and measuring how well the model performs, or has it ‘seen’ it in its training already?
2022-05-04T14:53:05Z
Only thetrain_datasetis used for training, so unless you have some overlap between thetrain_datasetand theeval_datasetyou passed to theTrainer, the answer is no.
2022-05-04T15:43:03Z
Great, thank you so much for your answer!