Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,313

Full-text search

Active filters: 8-bit

mobiuslabsgmbh/Qwen2.5-7B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 17 days ago • 60 • 2

neuralmagic/DeepSeek-R1-Llama-70B-quantized.w8a8

Updated 16 days ago • 32 • 1

S010/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q8-mlx

Text Generation • Updated 16 days ago • 165 • 2

MaziyarPanahi/Qwen2.5-14B-Instruct-1M-GGUF

Text Generation • Updated 15 days ago • 279 • 2

MikeRoz/ArliAI_Llama-3.3-70B-ArliAI-RPMax-v1.4-8.0bpw-h8-exl2

Updated 14 days ago • 41 • 2

mobiuslabsgmbh/Mixtral-8x7B-Instruct-v0.1_4bitgs64_hqq_hf

Text Generation • Updated 13 days ago • 37 • 1

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-r_MLX-8bit

Text Generation • Updated 12 days ago • 36 • 1

rinna/qwen2.5-bakeneko-32b-instruct-gptq-int8

Text Generation • Updated 10 days ago • 49 • 1

MaziyarPanahi/german-r1-GGUF

Text Generation • Updated 12 days ago • 586 • 1

AlejandroOlmedo/DeepScaleR-1.5B-Preview-8bit-mlx

Text Generation • Updated about 6 hours ago • 99 • 2

mlx-community/simplescaling-s1.1-32B-8bit

Text Generation • Updated 8 days ago • 25 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-GPTQ-W8A8

Text Generation • Updated 9 days ago • 22 • 1

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • Updated 9 days ago • 171 • 1

Statuo/Cydonia-24B-v2-EXL2-8bpw

Updated 9 days ago • 22 • 1

MaziyarPanahi/DeepSeek-llama3.1-Bllossom-8B-GGUF

Text Generation • Updated 9 days ago • 623 • 1

AlejandroOlmedo/zeta-8bit-mlx

Updated 5 days ago • 13 • 1

Pinkstack/Superthoughts-lite-v1-Q8-mlx

Text Generation • Updated 9 days ago • 10 • 1

mlx-community/zed-industries-zeta-8bit

Updated 8 days ago • 33 • 1

MaziyarPanahi/UIGEN-7B-16bit-GGUF

Text Generation • Updated 7 days ago • 125 • 1

miabchdave/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-MLX-8Q

Question Answering • Updated 5 days ago • 29 • 1

MikeRoz/LatitudeGames_Wayfarer-Large-70B-Llama-3.3-8.0bpw-h8-exl2

Text Generation • Updated 4 days ago • 14 • 1

mlx-community/DeepScaleR-1.5B-Preview-Q8

Text Generation • Updated 4 days ago • 32 • 1

ReturnHere/SecurityDeepSeek

Updated 4 days ago • 1

mlx-community/FuseO1-R1-QwQ-SkyT1-Flash-32B-Q8

Updated 3 days ago • 6 • 1

reinforce20001/SakuraLLM.Sakura-14B-Qwen2.5-v1.0-W8A8-Int8-V2

Updated 2 days ago • 56 • 1

MaziyarPanahi/SmolLM2-1.7B-Instruct-16k-GGUF

Text Generation • Updated 2 days ago • 86 • 1

MaziyarPanahi/ALLaM-7B-Instruct-preview-reasoning-GGUF

Text Generation • Updated 2 days ago • 80 • 1

MaziyarPanahi/Lamarck-14B-v0.7-Fusion-GGUF

Text Generation • Updated about 4 hours ago • 1

MikeRoz/sophosympatheia_Evathene-v1.3-8.0bpw-h8-exl2

Text Generation • Updated Dec 3, 2024 • 11 • 1

mlx-community/Evathene-v1.3-MLX-8Bit

Text Generation • Updated Jan 22 • 14 • 1