Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model:
|
3 |
+
- TheDrummer/Snowpiercer-15B-v1
|
4 |
+
base_model_relation: quantized
|
5 |
+
quantized_by: FrenzyBiscuit
|
6 |
+
license: mit
|
7 |
+
tags:
|
8 |
+
- awq
|
9 |
+
---
|
10 |
+
|
11 |
+
AWQ quant by FrenzyBiscuit.
|
12 |
+
|
13 |
+
Model was quantized down to INT4 using GEMM kernels, with zero-point quantization and a group size of 64.
|
14 |
+
|
15 |
+
Please note that I have not personally tested this to verify it works.
|
16 |
+
|
17 |
+
<img src="./frenzy.png"></img>
|