FrenzyBiscuit commited on
Commit
7dbb4b1
·
verified ·
1 Parent(s): 421e567

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - TheDrummer/Snowpiercer-15B-v1
4
+ base_model_relation: quantized
5
+ quantized_by: FrenzyBiscuit
6
+ license: mit
7
+ tags:
8
+ - awq
9
+ ---
10
+
11
+ AWQ quant by FrenzyBiscuit.
12
+
13
+ Model was quantized down to INT4 using GEMM kernels, with zero-point quantization and a group size of 64.
14
+
15
+ Please note that I have not personally tested this to verify it works.
16
+
17
+ <img src="./frenzy.png"></img>