MetaphoricalCode
/

QwQ-32B-Snowdrop-v0-exl3-4.5bpw-hb8

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

MetaphoricalCode commited on May 17

Commit

9f54338

·

verified ·

1 Parent(s): 1a5e977

Upload README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ tags:
 - mergekitty
 - merge
 ---
-## Quantized using the default exllamav3 (0.0.1) quantization process.
 - Original model: https://huggingface.co/trashpanda-org/QwQ-32B-Snowdrop-v0
 - exllamav3: https://github.com/turboderp-org/exllamav3

 - mergekitty
 - merge
 ---
+## Quantized using the default exllamav3 (0.0.2) quantization process.
 - Original model: https://huggingface.co/trashpanda-org/QwQ-32B-Snowdrop-v0
 - exllamav3: https://github.com/turboderp-org/exllamav3