How to train a model for ner pipeline [RoBERTa]
Greetings,I have followed the post to train a new model atHow to train a new language model from scratch using Transformers and Tokenizers.The result of that training is that made a modelRobertaForMaskedLMthat was then uploaded to huggingface modelAndrija/SRoBERTa(For now this is just a experimental run with smaller dataset and 1 epoch)However I am interested how would I train the model such as when I load the model and choose “NER” aka “token-classification” in this instance it would be a RobertaForTokenClassification) as pipeline that it won’t give a warning that it is not trained (which I know it is not).How would I accomplish such a task? I feel I am asking a stupid question, however if you could help I would appreciate it.Should I just load the model and “finetune” just to train the headI found some relevant post and I follow the same things and tried to accomplish thatcolab codeHowever I am am getting:image1256×467 25.4 KBAny hints are welcome!Best regards,Andrija