ArtusDev commited on
Commit
3f30ac5
·
verified ·
1 Parent(s): 58d5e0a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -2,6 +2,8 @@
2
  base_model: ConicCat/Mistral-Small-3.2-AntiRep-24B
3
  base_model_relation: quantized
4
  quantized_by: ArtusDev
 
 
5
  ---
6
 
7
  ## EXL3 Quants of ConicCat/Mistral-Small-3.2-AntiRep-24B
@@ -11,6 +13,7 @@ EXL3 quants of [ConicCat/Mistral-Small-3.2-AntiRep-24B](https://huggingface.co/C
11
  ### Quants
12
  | Quant(Revision) | Bits per Weight | Head Bits |
13
  | -------- | ---------- | --------- |
 
14
  | [3.0_H6](https://huggingface.co/ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3/tree/3.0bpw_H6) | 3.0 | 6 |
15
  | [3.5_H6](https://huggingface.co/ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
16
  | [4.0_H6](https://huggingface.co/ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
@@ -35,4 +38,4 @@ Download quant by targeting the specific quant revision (branch):
35
  ```
36
  huggingface-cli download ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3 --revision "5.0bpw_H6" --local-dir ./
37
  ```
38
- </details>
 
2
  base_model: ConicCat/Mistral-Small-3.2-AntiRep-24B
3
  base_model_relation: quantized
4
  quantized_by: ArtusDev
5
+ tags:
6
+ - exl3
7
  ---
8
 
9
  ## EXL3 Quants of ConicCat/Mistral-Small-3.2-AntiRep-24B
 
13
  ### Quants
14
  | Quant(Revision) | Bits per Weight | Head Bits |
15
  | -------- | ---------- | --------- |
16
+ | [2.5_H6](https://huggingface.co/ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3/tree/2.5bpw_H6) | 2.5 | 6 |
17
  | [3.0_H6](https://huggingface.co/ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3/tree/3.0bpw_H6) | 3.0 | 6 |
18
  | [3.5_H6](https://huggingface.co/ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
19
  | [4.0_H6](https://huggingface.co/ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
 
38
  ```
39
  huggingface-cli download ArtusDev/ConicCat_Mistral-Small-3.2-AntiRep-24B-EXL3 --revision "5.0bpw_H6" --local-dir ./
40
  ```
41
+ </details>