aoi-ot commited on
Commit
870ddcc
·
verified ·
1 Parent(s): d9e9d1f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -10,6 +10,15 @@ tags:
10
 
11
  ## VibeVoice: A Frontier Open-Source Text-to-Speech Model
12
 
 
 
 
 
 
 
 
 
 
13
  VibeVoice is a novel framework designed for generating expressive, long-form, multi-speaker conversational audio, such as podcasts, from text. It addresses significant challenges in traditional Text-to-Speech (TTS) systems, particularly in scalability, speaker consistency, and natural turn-taking.
14
 
15
  A core innovation of VibeVoice is its use of continuous speech tokenizers (Acoustic and Semantic) operating at an ultra-low frame rate of 7.5 Hz. These tokenizers efficiently preserve audio fidelity while significantly boosting computational efficiency for processing long sequences. VibeVoice employs a next-token diffusion framework, leveraging a Large Language Model (LLM) to understand textual context and dialogue flow, and a diffusion head to generate high-fidelity acoustic details.
 
10
 
11
  ## VibeVoice: A Frontier Open-Source Text-to-Speech Model
12
 
13
+ > This repository contains a copy of model weights obtained from ModelScope([microsoft/VibeVoice-Large](https://www.modelscope.cn/models/microsoft/VibeVoice-Large)).
14
+ > The license for this model is the `MIT License`, **which permits redistribution**.
15
+ >
16
+ > My understanding of the MIT License, which is consistent with the broader open-source community's consensus,
17
+ > is that it grants the right to distribute copies of the software and its derivatives.
18
+ > Therefore, I am lawfully exercising the right to redistribute this model.
19
+ >
20
+ > If you are a rights holder and believe this understanding of the license is incorrect, please submit a DMCA complaint to Hugging Face at [email protected]_
21
+
22
  VibeVoice is a novel framework designed for generating expressive, long-form, multi-speaker conversational audio, such as podcasts, from text. It addresses significant challenges in traditional Text-to-Speech (TTS) systems, particularly in scalability, speaker consistency, and natural turn-taking.
23
 
24
  A core innovation of VibeVoice is its use of continuous speech tokenizers (Acoustic and Semantic) operating at an ultra-low frame rate of 7.5 Hz. These tokenizers efficiently preserve audio fidelity while significantly boosting computational efficiency for processing long sequences. VibeVoice employs a next-token diffusion framework, leveraging a Large Language Model (LLM) to understand textual context and dialogue flow, and a diffusion head to generate high-fidelity acoustic details.