File size: 446 Bytes
1457154 97e1f90 ed26bbf |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
base_model: Steelskull/L3.3-MS-Nevoria-70b
library_name: transformers
quantized_by: Sinensis
pipeline_tag: text-generation
tags:
- mergekit
- merge
---
## AWQ quantization of [Steelskull/L3.3-MS-Nevoria-70b](https://huggingface.co/Steelskull/L3.3-MS-Nevoria-70b)
"quantization_config": {
"bits": 4,
"group_size": 128,
"modules_to_not_convert": null,
"quant_method": "awq",
"version": "gemm",
"zero_point": true
} |