Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

385

Base only

Active filters: lm-studio

froggeric/Qwen-Fixed-Chat-Templates

Updated 3 days ago • 1.15k

peculiar-ragdoll/Qwen-Sharp-Chat-Templates

Updated 2 days ago • 35

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 17.7k • 128

BennyDaBall/Z-Image-Engineer-V6-GGUF

Text Generation • 4B • Updated Jun 22 • 5.99k • 49

deadbydawn101/gemma-4-E4B-Agentic-Sol-Fable-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated 23 days ago • 3.34k • 4

richardyoung/Qwen3-14B-abliterated-GGUF

Text Generation • 15B • Updated Mar 23 • 3.82k • 4

lius-cc/Daoism-Qwen3.5-9B-GGUF

Text Generation • 9B • Updated May 16 • 32 • 1

OBLITERATUS/Qwen3.6-27B-OBLITERATED

Text Generation • 27B • Updated May 23 • 14.9k • 191

autotrust/gemma4-31B-Fable-5-Distilled-GGUF

Image-Text-to-Text • 31B • Updated Jun 30 • 1.34k • 12

BennyDaBall/Krea-2-Engineer-V1

Text Generation • Updated Jun 28 • 36

King3Djbl/nexus-security-GGUF

Text Generation • 2B • Updated about 1 month ago • 1.75k • 4

exnivo/LoafLM-10M

Text Generation • 10.3M • Updated 16 days ago • 457 • 3

Verdugie/Therapy-9B

Text Generation • 9B • Updated 11 days ago • 123 • 1

lucasbischofchaperon/Sophia-v2

Text Generation • 8B • Updated Jul 12 • 479 • 1

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated 18 days ago • 1.13k • 3

uzairkhn/Llama-3.2-1B-Instruct-Uncensored

Text Generation • Updated 17 days ago • 26 • 1

NANI-Nithin/Mellum2-12B-A2.5B-Instruct-GGUF

Text Generation • 12B • Updated 11 days ago • 197 • 1

loushek5/Qwen3.5-2B-HaloQ-Q5_0-GGUF

Text Generation • 2B • Updated 4 days ago • 187 • 2

alexander-model/gpt_model_safe

Text Generation • 21B • Updated Aug 28, 2025 • 11

dinhquangson/MonkeyOCR-pro-1.2B-Vision-GGUF

Image-Text-to-Text • 1B • Updated Sep 12, 2025 • 1.32k • 3

jsmith0475/sleeper-proxy-tinyllama-1.1b

Text Generation • 1B • Updated Sep 14, 2025 • 11 •

jsmith0475/sleeper-proxy-tinyllama-1.1b-gguf

Text Generation • 1B • Updated Sep 14, 2025 • 74 • 1

richardyoung/Qwen2.5-7B-Instruct-abliterated-GGUF

Text Generation • 8B • Updated Mar 23 • 5.07k • 1

snowmead/qwen3-0.6b-rust-sft-GGUF

0.6B • Updated Dec 11, 2025 • 5

kingjux/ffmpeg-command-generator-gguf

0.5B • Updated Dec 14, 2025 • 15

SiddhJagani/NVIDIA-Nemotron-Nano-12B-v2-mlx-Q6

Text Generation • 12B • Updated Dec 26, 2025 • 16

HexQuant/Pars-Medical-o1-Llama-FFT-GGUF

Text Generation • 3B • Updated Dec 22, 2025 • 25 • 1

purplesquirrelnetworks/purple-squirrel-r1-gguf

Text Generation • 8B • Updated Feb 23 • 40

ermiaazarkhalili/Qwen2.5-0.5B-SFT-UltraChat-GGUF

0.5B • Updated Apr 18 • 21

ermiaazarkhalili/Qwen2.5-1.5B-SFT-UltraChat-GGUF

2B • Updated Apr 18 • 29