Using the same dataset for fine-tuning and training
Hi, I’m working on a project that utilizes BERT model.initially, I have split the dataset 80/20 training/testing.then I used the training split for fine-tuning the BERT model using Trainer, and testing was passed for validation.after that, I have extracted the BERT embeddings, and stacked it on a TF model, then compiled it,then trained it using the same portion of data used for the fine-tuningmy question is:is it OK to use the same data portion forfine-tuningANDtraining?would that cause over-fitting?I searched for similar posts but I couldn’t find any answer,thanks in advance.
2022-04-29T07:40:03Z
As long as you have one held-out set that is never used for during-training-evaluation (only as a final test set), that’s okay. It’s not different from training for multiple epochs.
2022-05-07T14:02:06Z
Perfect!, Thanks a lot.