Speech recognition processing max_length
Hello. I am working on an automatic speech recognition project. But most of the models say that the maximum processing time is 30 seconds. If the original data is longer than 30 seconds, I would like to know how to handle it. For example, is there a way to handle it in code other than manually dividing the original data?
2024-10-19T12:18:19Z
This might have something to do with it.Whisper on long audio files -- support for chunking?🤗TransformersThe transformer library supports chunking (concatenation of multiple segments) for transcribing long audio files with Wav2Vec2, as described here:Making automatic speech recognition work on large files with Wav2Vec2 inTransformersThe OpenAI repository contains code for chunking with Whisper:whisper/transcribe.py at main · openai/whisper · GitHubIs chunking with Whisper supported in the transformers library?huggingface.coopenai/whisper-large-v3 · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2024-10-19T12:38:27Z
Thanks for pointing out a good way. But I was referring to the preprocessing of the dataset before fine-tuning. So I was wondering how to divide the data with text and audio into answer chunks, if possible.
2024-10-19T12:42:18Z
Would it be a pre-processing thing?huggingface.coPreprocessing an audio dataset - Hugging Face Audio CourseWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.coA Complete Guide to Audio DatasetsWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2024-10-19T13:13:02Z
Thanks for the great resources. These are correct, but they are things I’ve referenced in the past. According to the tutorial, 30 seconds is the maximum. I can’t use the data after 30 seconds because it returns false. It says to discard anything over 30 seconds.
2024-10-19T14:22:20Z
Would you simply split the file?PyPIaudio-splitterA CLI tool for splitting audio files into equally-sized chunks or based on periods of silence
2024-10-19T14:39:20Z
That’s a nice package. So I guess the only way to divide text into chunks is to do it myself?
2024-10-19T14:44:13Z
I think it would be best if there was an integrated dataset processing library, but if the current one doesn’t support it…Even though sound and text are bundled together, they are completely different information from the program’s point of view, so we need a program that ties the two together and finds the split point.We should have to do SR at the stage of creating the data set. It’s hard to do this manually.I wonder if anyone has made one…Edit:It’s close, but there’s no function for text splitting.github.comGitHub - davidmartinrius/speech-dataset-generator: 🔊 Create labeled datasets, enhance audio quality,...🔊 Create labeled datasets, enhance audio quality, identify speakers, support diverse dataset types. 🎧👥📊 Advanced audio processing.Other famous libraries when doing it manuallyGeeksforGeeks – 9 Dec 23Preprocessing the Audio Dataset - GeeksforGeeksA Computer Science portal for geeks. It contains well written, well thought and well explained computer science and programming articles, quizzes and practice/competitive programming/company interview Questions.
2024-10-19T15:22:12Z
Isn’t this one close?github.comGitHub - bluesignum/Audio-SentenceSplit: With one whole audio and corresponding text, the...With one whole audio and corresponding text, the audio can be split line by line and saved with exact sentence using comparison with the data from Google Speech Recognition API
2024-10-20T03:23:01Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.