metadata
base_model: ReadyArt/The-Omega-Directive-M-12B-Unslop-v2.0
base_model_relation: quantized
quantized_by: FrenzyBiscuit
The Omega Directive M 12B Unslop v2.0
Released by ReadyArt
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 64