metadata
base_model:
- TheDrummer/Snowpiercer-15B-v1
base_model_relation: quantized
quantized_by: FrenzyBiscuit
license: mit
tags:
- awq
Snowpiercer 15B v1
Released by TheDrummer
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 64