Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25

Base only

Active filters: q4-k-m

shafire/OpenZero-Ouroboros-3.8B-GGUF

Text Generation • 4B • Updated 3 days ago • 379 • 2

regolo/brick-complexity-2-eco-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 20 • 33 • 1

regolo/brick-complexity-2-max-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 20 • 23 • 1

FrontisAI/Frontis-MA1-35B-GGUF

Image-Text-to-Text • 35B • Updated 22 days ago • 4.36k • 7

daksh-neo/acervo-extractor-qwen3.5-9b-GGUF

Text Generation • 9B • Updated Mar 25 • 40 • 1

continuum-ai/qwen3.5-4b-code-forged

Text Generation • 4B • Updated Apr 11 • 152 • 1

continuum-ai/qwen3.5-4b-code-forged-defragged

Text Generation • 4B • Updated Apr 11 • 42

continuum-ai/qwen3.5-4b-code-forged-GGUF

Text Generation • 4B • Updated Apr 11 • 579 • 6

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 1.49k • 2

regolo/brick-complexity-extractor-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 13 • 10

helenk/gemma-4-E4B-finetune-GGUF

Text Generation • 7B • Updated May 9 • 55 • 1

helenk/gemma-4-E2B-finetune-GGUF

Text Generation • 5B • Updated May 9 • 10 • 2

josoroma/gemma-4-codigo-trabajo-gguf

Text Generation • 31B • Updated May 10 • 12

originalGeek/Orthrus-Qwen3-8B-GGUF

Text Generation • 10B • Updated Jun 13 • 22

shira-qwq/RUM-F2K-4B-1296000-GGUF

Text-to-Image • 4B • Updated Jul 1 • 14

shibatch/tinygemma3-2m

Text Generation • 1.56M • Updated 9 days ago • 23

coolthor/Laguna-S-2.1-attnQ8-DFlash-Q4-GGUF

Text Generation • 118B • Updated Jul 22 • 924 • 3

coolthor/Sulphur-2-distilled-Q4_K_M-GGUF

Text-to-Video • 21B • Updated Jul 22 • 5.72k • 2

empgces/gemma3-270m-grounded-behavior-finetuned-v9-GGUF

Text Generation • 0.3B • Updated 25 days ago • 372

FrontisAI/Frontis-MA1-30B-GGUF

Text Generation • 31B • Updated 22 days ago • 501 • 2

Tidalluna/DeepSeek-V4-Flash-0731-Tina-CQ4KM

Text Generation • Updated 19 days ago • 308 • 1

tahsinahsen/birag-gemma4-e2b-response-only-gguf

Text Generation • 5B • Updated 18 days ago • 219 • 1

stenml/BowLingual-12B-v1-GGUF

Text Generation • 12B • Updated 16 days ago • 112

NANI-Nithin/Muse-Glimmer-30B-GGUF

Image-Text-to-Text • 28B • Updated 12 days ago • 3.83k • 4

steven0226/qwen3vl-8b-chartqa-gguf

Image-Text-to-Text • 8B • Updated 9 days ago • 183