Llama 3.1 GPTQ, AWQ, and BNB Quants
Collection
Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗
•
9 items
•
Updated
•
57
Totally Free + Zero Barriers + No Login Required