Hugging Face's logo

altomek
/
Llama-3.2-3B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
facebook
meta
llama
llama-3
imatrix
conversational
Model card Files Community

Llama-3.2-3B-Instruct

Selected GGUF quants of https://huggingface.co/alpindale/Llama-3.2-3B-Instruct

Downloads last month
32
GGUF
Model size
3.21B params
Architecture
llama

4-bit

Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for altomek/Llama-3.2-3B-Instruct-GGUF

Base model

alpindale/Llama-3.2-3B-Instruct
Quantized
(5)
this model

Collection including altomek/Llama-3.2-3B-Instruct-GGUF