Sinensis's picture
Update README.md
ed26bbf verified
|
raw
history blame
446 Bytes
metadata
base_model: Steelskull/L3.3-MS-Nevoria-70b
library_name: transformers
quantized_by: Sinensis
pipeline_tag: text-generation
tags:
  - mergekit
  - merge

AWQ quantization of Steelskull/L3.3-MS-Nevoria-70b

"quantization_config": { "bits": 4, "group_size": 128, "modules_to_not_convert": null, "quant_method": "awq", "version": "gemm", "zero_point": true }