EfficientQAT(GPTQ format) - a ChenMnZ Collection

ChenMnZ 's Collections

EfficientQAT(w/o E2E-FT)

EfficientQAT(GPTQ format)

EfficientQAT (BitBLAS format)

EfficientQAT(GPTQ format)

updated Aug 6, 2024

EfficientQAT quantized models with GPTQ data format.

ChenMnZ/Llama-3-70b-EfficientQAT-w4g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 6
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 83
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 77
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64-GPTQ

Text Generation • Updated Jul 22, 2024 • 87
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 105 • 1
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 81 • 1
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64-GPTQ

Text Generation • Updated Jul 22, 2024 • 76
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 7
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g64-GPTQ

Text Generation • Updated Jul 22, 2024 • 46
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 6
ChenMnZ/Llama-3-70b-EfficientQAT-w2g64-GPTQ

Text Generation • Updated Jul 22, 2024 • 4
ChenMnZ/Llama-3-70b-EfficientQAT-w2g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 4
ChenMnZ/Llama-2-7b-EfficientQAT-w4g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 81
ChenMnZ/Llama-2-7b-EfficientQAT-w2g64-GPTQ

Text Generation • Updated Jul 22, 2024 • 77
ChenMnZ/Llama-2-7b-EfficientQAT-w2g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 165
ChenMnZ/Llama-2-70b-EfficientQAT-w4g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 5
ChenMnZ/Llama-2-70b-EfficientQAT-w2g64-GPTQ

Text Generation • Updated Jul 22, 2024 • 4
ChenMnZ/Llama-2-70b-EfficientQAT-w2g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 4
ChenMnZ/Llama-2-13b-EfficientQAT-w4g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 76
ChenMnZ/Llama-2-13b-EfficientQAT-w2g128-GPTQ

Text Generation • Updated Jul 22, 2024 • 79
ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ

Updated Aug 6, 2024 • 7 • 25