cgus
/

Mistral-Small-3.1-DRAFT-0.5B-exl2

Text Generation

mistral-small-3.1

4-bit precision

Model card Files Files and versions

cgus commited on Mar 24

Commit

27d173f

·

verified ·

1 Parent(s): d7fc577

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -26,9 +26,9 @@ Based on: [Qwen2.5-0.5B](https://huggingface.co/Qwen/Qwen2.5-0.5B) by [Qwen](htt
 ## Quants
 [4bpw h6 (main)](https://huggingface.co/cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2/tree/main)
-[5bpw h6](https://huggingface.co/cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2/tree/5bpw-h6)
-[6bpw h6](https://huggingface.co/cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2/tree/6bpw-h6)
-[8bpw h8](https://huggingface.co/cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2/tree/8bpw-h8)
 ## Quantization notes
 Made with Exllamav2 with default dataset.

 ## Quants
 [4bpw h6 (main)](https://huggingface.co/cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2/tree/main)
+[5bpw h6](https://huggingface.co/cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2/tree/5bpw-h6)
+[6bpw h6](https://huggingface.co/cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2/tree/6bpw-h6)
+[8bpw h8](https://huggingface.co/cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2/tree/8bpw-h8)
 ## Quantization notes
 Made with Exllamav2 with default dataset.