How to finetune Whisper with language which is not supported in WhisperTokenizer
According tofine-Tune Whisper For Multilingual ASR withTransformers, I can fine-tine the Whisper model with languages supported by WhisperTokenizer.However, if we need to make it support new language (which is not supported by the tokenizer), how could I do that? Could you please point me to the document or example which I could follow?
2023-05-20T14:43:19Z
I’m also searching for the same answer.
2023-09-12T14:56:04Z
Yes, i’m interested in this too. Particularly for very low resource languages like Wolof - do you need to train a BPE tokenizer given Wolof transcriptions, then pass the vocab.json and the merge file to the WhisperTokenizer?
2024-04-05T15:14:43Z
did you by any chance figure out a solution? I’m in the same situation now for a different language, and I wonder if you have some advice for me.Thanks in advance!
2024-05-18T04:15:33Z
Has anyone been able to fine tune Whisper in a new language?