Update README.md
Browse files
README.md
CHANGED
@@ -2,9 +2,9 @@
|
|
2 |
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-8B-abliterated-v1
|
3 |
---
|
4 |
|
5 |
-
|
6 |
|
7 |
-
|
8 |
|
9 |
| Model | Q4 | Q6 | Q8 | FP16 |
|
10 |
| ------------------------------------------------------------------------------------------------------------------------------ | ---- | ---- | ---- | ---- |
|
|
|
2 |
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-8B-abliterated-v1
|
3 |
---
|
4 |
|
5 |
+
[EXL3](https://github.com/turboderp-org/exllamav3) quantization of [Josiefied-Qwen3-8B-abliterated-v1](https://huggingface.co/Goekdeniz-Guelmez/Josiefied-Qwen3-8B-abliterated-v1), 4 bits per weight.
|
6 |
|
7 |
+
## HumanEval (argmax)
|
8 |
|
9 |
| Model | Q4 | Q6 | Q8 | FP16 |
|
10 |
| ------------------------------------------------------------------------------------------------------------------------------ | ---- | ---- | ---- | ---- |
|