Update README.md
Browse files
README.md
CHANGED
@@ -23,6 +23,8 @@ The National Library of Sweden releases a new suite of Whisper models trained on
|
|
23 |
| [large-v3](https://huggingface.co/KBLab/kb-whisper-large) | **KBLab** | **5.4** | **4.1** | **5.2** |
|
24 |
| | OpenAI | 7.8 | 9.5 | 11.3 |
|
25 |
|
|
|
|
|
26 |
### Usage
|
27 |
|
28 |
```python
|
@@ -74,6 +76,8 @@ The default when loading our models through Hugging Face is **Stage 2**. We have
|
|
74 |
|
75 |
### Evaluation
|
76 |
|
|
|
|
|
77 |
| Model size | | FLEURS | CommonVoice | NST |
|
78 |
|------------|---------|--------|-------------|------|
|
79 |
| [tiny](https://huggingface.co/KBLab/kb-whisper-tiny) | **KBLab** | **13.2** | **12.9** | **11.2** |
|
@@ -88,6 +92,7 @@ The default when loading our models through Hugging Face is **Stage 2**. We have
|
|
88 |
| | OpenAI | 7.8 | 9.5 | 11.3 |
|
89 |
|
90 |
|
|
|
91 |
| Model size | | FLEURS | CommonVoice | NST |
|
92 |
|------------|---------|--------|-------------|------|
|
93 |
| tiny | KBLab | **76.6** | **73.7** | **74.3** |
|
|
|
23 |
| [large-v3](https://huggingface.co/KBLab/kb-whisper-large) | **KBLab** | **5.4** | **4.1** | **5.2** |
|
24 |
| | OpenAI | 7.8 | 9.5 | 11.3 |
|
25 |
|
26 |
+
Table: **Word Error Rate (WER)** comparison between KBLab's Whisper models and the corresponding OpenAI versions.
|
27 |
+
|
28 |
### Usage
|
29 |
|
30 |
```python
|
|
|
76 |
|
77 |
### Evaluation
|
78 |
|
79 |
+
|
80 |
+
#### WER
|
81 |
| Model size | | FLEURS | CommonVoice | NST |
|
82 |
|------------|---------|--------|-------------|------|
|
83 |
| [tiny](https://huggingface.co/KBLab/kb-whisper-tiny) | **KBLab** | **13.2** | **12.9** | **11.2** |
|
|
|
92 |
| | OpenAI | 7.8 | 9.5 | 11.3 |
|
93 |
|
94 |
|
95 |
+
#### BLEU Score
|
96 |
| Model size | | FLEURS | CommonVoice | NST |
|
97 |
|------------|---------|--------|-------------|------|
|
98 |
| tiny | KBLab | **76.6** | **73.7** | **74.3** |
|