hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation
•
Updated
•
1.5k
•
6
Gemma2 AWQ Quants
Optimised AWQ Quants for high-throughput deployments of Gemma2! Compatible with Transformers, TGI & VLLM 🤗