isogen
/

Mistral-Small-3.1-24B-Instruct-2503-exl3-4bpw

4-bit precision

Model card Files Files and versions

Mistral-Small-3.1-24B-Instruct-2503-exl3-4bpw / README.md

isogen's picture

Update README.md

1e10e85 verified 3 months ago

|

434 Bytes

metadata

base_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503

EXL3 quantization of Mistral-Small-3.1-24B-Instruct-2503, 4 bits per weight, no vision.

For vision and other bitrates: turboderp/Mistral-Small-3.1-24B-Instruct-2503-exl3.