metadata
base_model:
- trashpanda-org/QwQ-32B-Snowdrop-v0
library_name: transformers
base_model_relation: quantized
quantized_by: frenzybiscuit
QwQ 32B Snowdrop v0
Released by trashpanda-org
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 128