HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
•
1
meta-llama/Llama-3.2-1B Quantized
Find the quantized versions of Llama-3.2-1B all in one place
-
-
HF-Quantization/Llama-3.2-1B-BNB-INT8
1B • Updated • 4 -
HF-Quantization/Llama-3.2-1B-BNB-NF4
1B • Updated • 2 -
HF-Quantization/Llama-3.2-1B-BNB-FP4
1B • Updated • 2 -
HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16
1B • Updated -
HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16
1B • Updated • 3 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated • 5 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated • 3 -
HF-Quantization/Llama-3.2-1B-GPTQ-INT4
1B • Updated • 2