Transformers for small datasets?
Many transformer models, like BERT and GPT, perform well on large datasets, but what about fine-turning them on smaller and highly specialized datasets? how can one determine the optimal learning rate or batch size for such cases?
2024-10-07T23:40:27Z
Following the post with curiosity, great question.
2024-10-09T05:23:20Z
is anybody there who can guide about it and he should also have some information aboutgrooming a show cocker?
2024-10-09T05:35:43Z
I’m there, but it’s too technical to answer…It’s a subject that someone might write a paper or an article on.