isogen's picture
Upload folder using huggingface_hub
1dcbeef verified
|
raw
history blame
1.16 kB
metadata
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-1.7B-abliterated-v1

EXL3 quantization of Josiefied-Qwen3-1.7B-abliterated-v1, 8 bits per weight, including output layers.

HumanEval (argmax)

Model Q4 Q6 Q8 FP16
Josiefied-Qwen3-1.7B-abliterated-v1-exl3-8bpw-h8 0.0% 62.2% 61.6% 62.8%
Qwen3-1.7B-exl3-8bpw-h8 0.0% 70.7% 68.3% 68.9%
Qwen3-1.7B-Base-exl3-8bpw-h8 0.0% 66.5% 70.7% 70.1%