This is a checkpoint for quantization using llm-compressor, supporting vllm, sglang inference.
- Downloads last month
- 428
Model tree for jiangchengchengNLP/L3.3-MS-Nevoria-70b-w8a16
Base model
Steelskull/L3.3-MS-Nevoria-70bThis is a checkpoint for quantization using llm-compressor, supporting vllm, sglang inference.
Base model
Steelskull/L3.3-MS-Nevoria-70b