Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

15,451

Full-text search

Active filters: llama-cpp

IntelligentEstate/Baby_Grok3-1.5b-iQ4_K_M-GGUF

Updated about 12 hours ago • 1.33k • 4

prithivMLmods/GWQ-9B-Preview2-Q8_0-GGUF

Text Generation • Updated Jan 8 • 29 • 7

prithivMLmods/GWQ-9B-Preview-Q6_K-GGUF

Text Generation • Updated Jan 8 • 20 • 7

prithivMLmods/GWQ-9B-Preview2-GGUF

Text Generation • Updated Jan 8 • 23 • 7

prithivMLmods/GWQ-9B-Preview2-Q6_K-GGUF

Text Generation • Updated Jan 8 • 18 • 7

prithivMLmods/GWQ-9B-Preview2-Q5_K_M-GGUF

Text Generation • Updated Jan 8 • 36 • 7

prithivMLmods/GWQ-9B-Preview-Q5_K_M-GGUF

Text Generation • Updated Jan 8 • 25 • 7

prithivMLmods/GWQ-9B-Preview-Q8_0-GGUF

Text Generation • Updated Jan 8 • 16 • 7

attashe/gemma-2-9b-it-russian-function-calling-GGUF-Q8_0-GGUF

Text Generation • Updated Jan 13 • 179 • 2

lukasfast/Teuken-7B-instruct-research-v0.4-Q6_K-GGUF

Text Generation • Updated Jan 22 • 65 • 2

maicog/DeepSeek-R1-Distill-Llama-8B-abliterated-Q4_K_S-GGUF

Updated Jan 23 • 2.22k • 5

NikolayKozloff/Selene-1-Mini-Llama-3.1-8B-Q6_K-GGUF

Text Generation • Updated 25 days ago • 77 • 3

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated 24 days ago • 1.18k • 2

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-Q8_0-GGUF

Text Generation • Updated 24 days ago • 160 • 2

NikolayKozloff/DeepSeek-R1-Distill-Qwen-1.5B-Multilingual-Q8_0-GGUF

Updated 23 days ago • 1.83k • 2

Novaciano/Lancer-1-1b-Victoria-GGUF

Updated 6 days ago • 30 • 2

smirki/UIGEN-T1.1-Qwen-7B-Q4_K_M-GGUF

Updated 5 days ago • 125 • 2

Omartificial-Intelligence-Space/ALLaM-7B-Instruct-preview-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 66 • 2

smirki/UIGEN-T1.1-Qwen-32B-Q4_K_M-GGUF

Updated 4 days ago • 169 • 2

NikolayKozloff/Reverb-7b-Q6_K-GGUF

Text Generation • Updated 3 days ago • 22 • 2

smirki/UIGEN-T1.2-Tailwind-14B-Q8_0-GGUF

Updated 2 days ago • 29 • 2

ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

Updated Apr 5, 2024 • 939 • 3

NikolayKozloff/csmpt7b-Czech-GGUF

Updated Apr 6, 2024 • 41 • 4

DavidAU/RolePlayLake-7B-Q6_K-GGUF

Updated Apr 10, 2024 • 68 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Aug 9, 2024 • 1.7k • 21

DavidAU/Rosa_v1_3B-Q6_K-GGUF

Updated Apr 12, 2024 • 13 • 2

DavidAU/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-Q6_K-GGUF

Text Generation • Updated Apr 21, 2024 • 573 • 4

Bessa/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 21 • 1

djward888/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 18 • 2

djward888/llava-llama-3-8b-v1_1-Q3_K_S-GGUF

Image-Text-to-Text • Updated Apr 22, 2024 • 41 • 1