Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

Misc with no match

8-bit precision

Models

14,062

Full-text search

Active filters: gguf-my-repo

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix-Q4_K_M-GGUF

Text Generation • Updated Nov 21, 2024 • 24 • 1

ZeroXClem/Qwen2.5-7B-HomerAnvita-NerdMix-Q4_0-GGUF

Text Generation • Updated Nov 21, 2024 • 25 • 1

matrixportal/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • Updated Nov 22, 2024 • 151 • 1

Shamil12/Gemma-1B-Q2_K-GGUF

Updated Nov 24, 2024 • 9 • 1

Triangle104/Qwen2.5-0.5B-Instruct-abliterated-Q4_K_M-GGUF

Text Generation • Updated Nov 25, 2024 • 4 • 1

ClaudioItaly/Intelligence-7Ties-Q4_K_M-GGUF

Updated Nov 26, 2024 • 1 • 1

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • Updated Nov 26, 2024 • 2.33k • 3

ClaudioItaly/Intelligence-7Ties-Q5_K_M-GGUF

Updated Nov 26, 2024 • 2 • 1

Triangle104/Cydonia-v1.3-Magnum-v4-22B-Q5_K_M-GGUF

Updated Nov 26, 2024 • 19 • 1

cnmoro/Tucano-1b1-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 30, 2024 • 5 • 1

cnmoro/Tucano-2b4-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 30, 2024 • 16 • 2

Triangle104/OLMo-2-1124-13B-Q6_K-GGUF

Updated Dec 1, 2024 • 7 • 2

Lyte/LLaMA-O1-Supervised-1129-Q4_K_M-GGUF

Updated Dec 2, 2024 • 25 • 4

YATIDE/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Dec 2, 2024 • 1.36k • 1

matrixportal/Llama-3.2-3B-Instruct-uncensored-Q4_K_M-GGUF

Updated Dec 3, 2024 • 40 • 1

Triangle104/Mistral-Nemo-12B-ArliAI-RPMax-v1.3-Q4_K_M-GGUF

Updated Dec 6, 2024 • 184 • 1

ehristoforu/Llama-TI-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 8, 2024 • 12 • 2

puettmann/LlaMaestra-3.2-1B-Translation-Q8_0-GGUF

Translation • Updated Dec 8, 2024 • 62 • 1

SYNERDATA/SYNERDATA-Hermes-3-LLaMA-3.1-8b-Q8_0.GGUF

Updated Dec 9, 2024 • 13 • 1

aovchinnikov/T-lite-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 188 • 6

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_S-GGUF

Updated Dec 11, 2024 • 19 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 11, 2024 • 22 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_S-GGUF

Updated Dec 11, 2024 • 6 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_M-GGUF

Updated Dec 12, 2024 • 10 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q6_K-GGUF

Updated Dec 12, 2024 • 13 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 9 • 1

NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 10 • 2

Ransss/Nemo-12b-Humanize-KTO-Experimental-Latest-Q8_0-GGUF

Updated Dec 19, 2024 • 101 • 1

ggml-org/jina-embeddings-v2-base-en-Q8_0-GGUF

Feature Extraction • Updated Dec 12, 2024 • 50 • 1

ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF

Feature Extraction • Updated Dec 12, 2024 • 34 • 1