Hugging Face's logo

RedHatAI
/
Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation
Safetensors
llama
int8
vllm
conversational
8-bit precision
compressed-tensors
Model card Files
xet
Community
Meta-Llama-3.1-405B-Instruct-quantized.w8a8
  • 2 contributors
 History: 14 commits
alexmarques's picture
alexmarques
Upload tokenizer_config.json with huggingface_hub
cb153b0 verified