Hugging Face's logo

Quant-Cartel
/
Phainesthesia-8x7B-iMat-GGUF

GGUF
Not-For-All-Audiences
GGUF
Merge
iMat
Inference Endpoints
conversational
Model card Files Community
1
InferenceIllusionist commited on
Commit
2c1a1e1
·
verified ·
1 Parent(s): c7c39be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -40,6 +40,7 @@ Please note importance matrix quantizations are a work in progress, IQ3 and abov
40
  | Quant | Size (GB) | Comments |
41
  |:-----|--------:|:------|
42
  | [IQ2_S](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ2_S.gguf) | 14.1 | |
 
43
  | [IQ3_XXS](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ3_XXS.gguf) | 18.2 | |
44
  | [IQ3_XS](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ3_XS.gguf) | 19.3 | |
45
  | [IQ3_S](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ3_S.gguf) | 20.4 | |
 
40
  | Quant | Size (GB) | Comments |
41
  |:-----|--------:|:------|
42
  | [IQ2_S](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ2_S.gguf) | 14.1 | |
43
+ | [IQ2_M](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ2_S.gguf) | 15.5 | |
44
  | [IQ3_XXS](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ3_XXS.gguf) | 18.2 | |
45
  | [IQ3_XS](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ3_XS.gguf) | 19.3 | |
46
  | [IQ3_S](https://huggingface.co/Quant-Cartel/Phainesthesia-8x7b-iMat-GGUF/blob/main/Phainesthesia-1.0-8x7b-iMat-IQ3_S.gguf) | 20.4 | |