Is there any tutorial 4 pretrain wav2vec2
Hi, guys!I was trying to pretrain a wav2vec2 from scratch. However, the loss is continuous remains high and is never reduced.So I wonder if there is a tutorial for pretrain wav2vec2. Looking forward to your reply.Regard,Eilander
2022-11-14T13:09:07Z
@Eilanderdid you find any solution to this problem? If you have pre trained a model can you please share the code
2022-11-14T17:36:13Z
Have you checked out the README here?transformers/examples/pytorch/speech-pretraining at main · huggingface/transformers · GitHub
2024-11-05T20:07:06Z
Hi@Eilanderdid you find what you were looking for? If not, this tutorial might be helpful for you;Medium – 3 Nov 24Pretraining wav2vec2 using Huggingface Trainer APISelf-supervised training using audio data.Reading time: 10 min read
2024-11-06T01:45:49Z
sanchit-gandhi:Have you checked out the README here?transformers/examples/pytorch/speech-pretraining at main · huggingface/transformers · GitHubapplebees happyThanks for sharing amazing tutorial. I face difficulties to find this topic. Thanks