Fine-tuning Whisper for Translation
Hi@sanchit-gandhi@MariaK, I have been following the guide to fine-tune whisper in the course and also looking at this blog.Fine-Tune Whisper For Multilingual ASR with 🤗 TransformersI wanted to know that if I want to fine-tune for translation instead of transcription, I only need to change the task in the WhisperAudioProcessor and the metrics (using BLEU instead of WER) in the compute metrics function right?Do I need to make any other changes to modify the code for translation to English?Best,Raj
2023-09-30T11:01:13Z
@RajSanghave you figured it out…what I think is we might also need a paired speech to English text data.
2023-11-14T05:56:48Z
up, I have the same question