Hugging Face's logo

isogen
/
Mistral-Small-3.1-24B-Instruct-2503-exl3-4bpw

Safetensors
mistral
4-bit precision
exl3
Model card Files
xet
Community
isogen commited on
Commit
1e10e85
·
verified ·
1 Parent(s): a722d57

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -1,5 +1,7 @@
1
  ---
2
- license: apache-2.0
3
  ---
4
 
5
- [EXL3](https://github.com/turboderp-org/exllamav3) quantization of [Mistral Small 3.1](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503), 4 bits per weight, no vision.
 
 
 
1
  ---
2
+ base_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503
3
  ---
4
 
5
+ [EXL3](https://github.com/turboderp-org/exllamav3) quantization of [Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503), 4 bits per weight, no vision.
6
+
7
+ For vision and other bitrates: [turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3).