Hugging Face's logo

jiangchengchengNLP
/
L3.3-MS-Nevoria-70B-NVFP4

Text Generation
Transformers
Safetensors
English
llama
multimodal
conversational
text-generation-inference
8-bit precision
compressed-tensors
Model card Files
xet
Community

This is a checkpoint for quantization using llm-compressor, supporting vllm

Downloads last month
11
Safetensors
Model size
40.6B params
Tensor type
F32
·
BF16
·
F8_E4M3
·
U8
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for jiangchengchengNLP/L3.3-MS-Nevoria-70B-NVFP4

Base model

Steelskull/L3.3-MS-Nevoria-70b
Quantized
(28)
this model