Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

207

Base only

Active filters: metal

EschaLabs/Qwen3.6-35B-A3B-Escha-W2

Text Generation • 7B • Updated 2 days ago • 4.5k • 246

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 8 days ago • 153k • 123

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 24 days ago • 839k • • 1.19k

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated 25 days ago • 2.71M • 758

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 7 days ago • 966k • 436

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 318k • 124

badtheorylabs/BTL-3-Compact

Text Generation • 8B • Updated 18 days ago • 2.53k • 40

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 28 days ago • 962k • 205

apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128

Text Generation • 284B • Updated 7 days ago • 1.29k • 4

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 78.2k • 765

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 57.1k • 87

Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit

Text Generation • 15B • Updated May 5 • 420 • 1

anemll/DeepSeek-V4-Flash-FP4-FP8-SSD

Text Generation • 7B • Updated Apr 29 • 197 • 8

mlboydaisuke/LFM2.5-8B-A1B-CoreAI

Text Generation • Updated 19 days ago • 81 • 2

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit

Image-Text-to-Text • 8B • Updated Jun 28 • 1.39k • 6

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-MLX-MTP-Drafter

0.4B • Updated Jun 28 • 2.19k • 3

coreai-community/MiniCPM5-1B-CoreAI

Text Generation • Updated Jul 3 • 1

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 28 days ago • 962k • 168

schlaflos/DeepSeek-V4-Flash-0731-antirez-ds4-GGUF

Text Generation • 20B • Updated 11 days ago • 6.24k • 10

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Quality128

Text Generation • 284B • Updated 7 days ago • 15.1k • 4

Leonickson/Qwen3-Next-80B-A3B-qpack

0.4B • Updated 8 days ago • 173 • 2

xxrickyxx/AILOFlow

Text Generation • Updated about 23 hours ago • 1

HarroweD/HarrlogosXL

Text-to-Image • Updated Jan 14, 2024 • 197 • • 15

RalFinger/chrome-style-sdxl-lora

Text-to-Image • Updated Nov 22, 2023 • 17 • • 1

e-n-v-y/envy-metallic-xl-01

Text-to-Image • Updated Nov 24, 2023 • 11 • • 2

UnionStreet/vision-1-mini

Text Classification • 8B • Updated Jan 16, 2025 • 22 • 1

halley-ai/gpt-oss-20b-MLX-4bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 119 • 3

halley-ai/gpt-oss-20b-MLX-6bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 26 • 1

halley-ai/gpt-oss-20b-MLX-5bit-gs32

Text Generation • 21B • Updated Sep 8, 2025 • 51 • 1

halley-ai/gpt-oss-120b-MLX-8bit-gs32

Text Generation • 117B • Updated Sep 8, 2025 • 60 • 1