isogen
/

Mistral-Small-3.1-24B-Instruct-2503-exl3-3bpw

Model card Files Files and versions

Mistral-Small-3.1-24B-Instruct-2503-exl3-3bpw / README.md

isogen's picture

Update README.md

88f2632 verified 3 months ago

|

history blame contribute delete

434 Bytes

	---
	base_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503
	---

	[EXL3](https://github.com/turboderp-org/exllamav3) quantization of [Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503), 3 bits per weight, no vision.

	For vision and other bitrates: [turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3](https://huggingface.co/turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3).