Can't load tokenizer after fine-tuning
Hi, all!I followed theEmotion recognition in Greek speech using Wav2Vec2notebook fromhereAfter finishing fine-tuning on my own data, I am getting the following error when trying to load the processor withprocessor = Wav2Vec2Processor.from_pretrained(model_name)The error:OSError: Can't load tokenizer for '[/path/to/model/]checkpoint-860/'. If you were trying to load it from 'https://huggingface.co/models', Otherwise, make sure '[/path/to/model/]checkpoint-860/' is the correct path to a directory containing all relevant files for a Wav2Vec2CTCTokenizer tokenizer.Checking thecheckpointfolder, there is no tokenizer file in there, am I missing something? The model is actually being saved byTrainer(). This is the content of the mentioned folder:PD: the model loads correctly withmodel = Wav2Vec2ForSpeechClassification.from_pretrained(model_name)
2023-03-01T14:55:57Z
I have the same problem, have you found a solution?