Hugging Face's logo

jiangchengchengNLP
/
L3.3-MS-Nevoria-70b-w8a16

Text Generation
Transformers
Safetensors
English
llama
multimodal
conversational
text-generation-inference
compressed-tensors
Model card Files
xet
Community
jiangchengchengNLP commited on
Commit
c078a6d
·
verified ·
1 Parent(s): e149ffb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -9,3 +9,4 @@ library_name: transformers
9
  base_model:
10
  - Steelskull/L3.3-MS-Nevoria-70b
11
  ---
 
 
9
  base_model:
10
  - Steelskull/L3.3-MS-Nevoria-70b
11
  ---
12
+ This is a checkpoint for quantization using llm-compressor, supporting vllm, sglang inference.