HF Quantization

community

AI & ML interests

Making AI models smaller, and faster with Quantization

HF-Quantization 's models 11

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4

Updated Jan 22 • 4

HF-Quantization/Llama-3.2-1B-BNB-INT8

1B • Updated Jan 21 • 7

HF-Quantization/Llama-3.2-1B-BNB-NF4

1B • Updated Jan 21 • 5

HF-Quantization/Llama-3.2-1B-BNB-FP4

1B • Updated Jan 21 • 5

HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16

1B • Updated Jan 21 • 4

HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16

1B • Updated Jan 21 • 4

HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8

Updated Jan 21 • 6

HF-Quantization/Llama-3.2-1B-TORCHAO-W8

Updated Jan 21 • 8

HF-Quantization/Llama-3.2-1B-TORCHAO-W4

Updated Jan 21 • 3

HF-Quantization/Llama-3.2-1B-GPTQ-INT4

1B • Updated Jan 21 • 5