Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

2,965

Full-text search

Active filters: 6-bit

nightmedia/Qwen3-4B-Thinking-2507-Sales-Strategist-v1-dwq6-mlx

Text Generation • 1B • Updated 6 days ago • 52

NexVeridian/gemma-3-270m-6bit

Text Generation • 0.1B • Updated 6 days ago • 33

nightmedia/Ring-lite-2507-q6-hi-mlx

Text Generation • 17B • Updated 6 days ago • 15

nightmedia/Ling-lite-1.5-2507-q6-hi-mlx

Text Generation • 17B • Updated 6 days ago • 15

nightmedia/unsloth-GLM-4.5-Air-q6-mlx

Text Generation • 107B • Updated 6 days ago • 113

nightmedia/unsloth-GLM-4.5-Air-q6-hi-mlx

Text Generation • 107B • Updated 5 days ago • 90

NexVeridian/Kimi-Dev-72B-6bit

Text Generation • 73B • Updated 5 days ago • 18

wobondar/gpt-oss-20b-mlx-6Bit

Text Generation • 21B • Updated 5 days ago • 94

SicariusSicariiStuff/Impish_Longtail_12B_EXL3_6.0bpw

Text Generation • 5B • Updated 4 days ago • 5

NexVeridian/GLM-4.5-Air-6bit

Text Generation • 107B • Updated 5 days ago • 70

mlx-community/Kimi-VL-A3B-Thinking-2506-6bit

Image-Text-to-Text • Updated 4 days ago • 32

DeathGodlike/MN-Chinofun-12B-4.1_EXL3

Text Generation • Updated 4 days ago • 7

DeathGodlike/Nemo-12b-Humanize-SFT-v0.2.5-KTO_EXL3

Text Generation • Updated 3 days ago • 7

nightmedia/unsloth-Qwen3-Coder-30B-A3B-Instruct-qx6-mlx

Text Generation • 31B • Updated about 1 hour ago • 107

NexVeridian/OpenReasoning-Nemotron-1.5B-6bit

Text Generation • 0.3B • Updated 2 days ago • 5

NexVeridian/OpenReasoning-Nemotron-7B-6bit

Text Generation • 8B • Updated 2 days ago • 3

NexVeridian/OpenReasoning-Nemotron-14B-6bit

Text Generation • 15B • Updated 2 days ago • 9

NexVeridian/OpenReasoning-Nemotron-32B-6bit

Text Generation • 33B • Updated 2 days ago • 15

NexVeridian/Kimi-VL-A3B-Thinking-2506-6bit

Text Generation • 16B • Updated 2 days ago • 14

nightmedia/Cydonia-24B-v4.1-q6-mlx

Text Generation • 24B • Updated 2 days ago • 6

nightmedia/Qwen3-Esper3-Reasoning-CODER-Instruct-21B-Brainstorm20x-128k-ctx-q6-mlx

Text Generation • 21B • Updated 1 day ago • 34

DeathGodlike/Rei-24B-KTO_EXL3

Text Generation • Updated 1 day ago • 3

nightmedia/Qwen3-30B-A3B-Thinking-2507-512k-qx6-mlx

Text Generation • 31B • Updated about 1 hour ago • 9

graelo/Magistral-Small-2507-6bits

Text Generation • 24B • Updated about 13 hours ago • 3

graelo/Devstral-Small-2507-6bits

Text Generation • 24B • Updated about 12 hours ago • 5