isogen's picture
Upload folder using huggingface_hub
e1b2699 verified
|
raw
history blame
1.23 kB
metadata
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-14B-abliterated-v3

EXL3 quantization of Josiefied-Qwen3-14B-abliterated-v3, 4 bits per weight.

HumanEval (argmax)

Model Q4 Q6 Q8 FP16
Josiefied-Qwen3-14B-abliterated-v3-exl3-4bpw 71.3 70.1 69.5 71.3
Josiefied-Qwen3-14B-abliterated-v3-exl3-6bpw 73.2 78.0 76.2 75.6
Qwen3-14B-exl3-4bpw 88.4 89.0 89.0 89.0
Qwen3-14B-exl3-6bpw 89.6 88.4 89.6 89.0