Hugging Face's logo

Pomni
/
distil-medium.en-ggml-allquants

Automatic Speech Recognition
English
whisper.cpp
ggml
whisper
audio
speech
voice
distil
Model card Files Community
Pomni commited on
Commit
e33cfe9
·
verified ·
1 Parent(s): fe2c1b4

Update quant list + fix inaccurate sizes

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -40,9 +40,10 @@ Clicking on a link will download the corresponding quant instantly.
40
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q5_1.bin) | Q5_1 | 308 MB | |
41
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q5_0.bin) | Q5_0 | 284 MB | Last "good" quant; anything below loses quality rapidly. |
42
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q4_k.bin) | Q4_K | 235 MB | *Might* not have lost too much quality, but I'm not sure. |
43
- | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q4_1.bin) | Q4_1 | 491 MB | |
44
- | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q4_0.bin) | Q4_0 | 444 MB | |
45
- | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q3_k.bin) | Q3_K | 345 MB | |
 
46
 
47
  The F32 quant was taken from [distil-whisper/distil-medium.en/ggml-medium-32-2.en.fp32.bin](https://huggingface.co/distil-whisper/distil-medium.en/blob/main/ggml-medium-32-2.en.fp32.bin), and the F16 quant was taken from [distil-whisper/distil-medium.en/ggml-medium-32-2.en.bin](https://huggingface.co/distil-whisper/distil-medium.en/blob/main/ggml-medium-32-2.en.bin).
48
  ## Questions you may have
 
40
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q5_1.bin) | Q5_1 | 308 MB | |
41
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q5_0.bin) | Q5_0 | 284 MB | Last "good" quant; anything below loses quality rapidly. |
42
  | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q4_k.bin) | Q4_K | 235 MB | *Might* not have lost too much quality, but I'm not sure. |
43
+ | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q4_1.bin) | Q4_1 | 260 MB | |
44
+ | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q4_0.bin) | Q4_0 | 235 MB | |
45
+ | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q3_k.bin) | Q3_K | 184 MB | |
46
+ | [GGML](https://huggingface.co/Pomni/distil-medium.en-ggml-allquants/resolve/main/ggml-distil-medium.en-q2_k.bin) | Q2_K | 144 MB | Completely non-sensical outputs. |
47
 
48
  The F32 quant was taken from [distil-whisper/distil-medium.en/ggml-medium-32-2.en.fp32.bin](https://huggingface.co/distil-whisper/distil-medium.en/blob/main/ggml-medium-32-2.en.fp32.bin), and the F16 quant was taken from [distil-whisper/distil-medium.en/ggml-medium-32-2.en.bin](https://huggingface.co/distil-whisper/distil-medium.en/blob/main/ggml-medium-32-2.en.bin).
49
  ## Questions you may have