Edit Models filters

Model Tree

Qwen/Qwen2.5-0.5B-Instruct

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

95

Full-text search

Active filters: Qwen/Qwen2.5-0.5B-Instruct

onnx-community/Qwen2.5-0.5B-Instruct

Text Generation • Updated Oct 8, 2024 • 563 • 4

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 9.26k • 8

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.82k • 7

Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 20, 2024 • 39.8k • 34

lmstudio-community/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 7.87k • 2

mlc-ai/Qwen2.5-0.5B-Instruct-q4f16_1-MLC

Updated Sep 18, 2024 • 75.2k • 1

unsloth/Qwen2.5-0.5B-Instruct-bnb-4bit

Text Generation • Updated 18 days ago • 18.7k • 3

kz919/QwQ-0.5B-Distilled-gguf

Updated Jan 3 • 64 • 2

Mozilla/Qwen2.5-0.5B-Instruct

Text Generation • Updated 12 days ago • 318 • 3

kz919/QwQ-0.5B-Distilled-SFT-gguf

Text Generation • Updated Jan 10 • 417 • 7

QuantFactory/lb-reranker-0.5B-v1.0-GGUF

Text Generation • Updated Jan 15 • 541 • 3

prithivMLmods/FastThink-0.5B-Tiny

Text Generation • Updated 24 days ago • 686 • 11

prithivMLmods/Bellatrix-Tiny-0.5B

Text Generation • Updated 27 days ago • 558 • 8

onnx-community/Qwen2.5-0.5B-Instruct-ONNX-MHA

Text Generation • Updated 24 days ago • 92 • 1

unsloth/Qwen2.5-0.5B-Instruct-unsloth-bnb-4bit

Text Generation • Updated 18 days ago • 20.9k • 1

prithivMLmods/Feynman-Grpo-Exp

Text Generation • Updated 16 days ago • 193 • 8

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 19, 2024 • 2.42k • 5

bartowski/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 8.56k • 4

MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 135 • 1

mlc-ai/Qwen2.5-0.5B-Instruct-q0f32-MLC

Updated Sep 19, 2024 • 47

mlc-ai/Qwen2.5-0.5B-Instruct-q0f16-MLC

Updated Sep 19, 2024 • 166 • 1

mlc-ai/Qwen2.5-0.5B-Instruct-q4f32_1-MLC

Updated Sep 19, 2024 • 170

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 18, 2024 • 1

second-state/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated 27 days ago • 616

gaianet/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated 27 days ago • 1.85k

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 1.33k

madroid/Qwen2.5-0.5B-Instruct-mlx-4bit

Text Generation • Updated Sep 19, 2024 • 12 • 1

DevQuasar/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Dec 4, 2024 • 23

SeanChang74/Qwen2.5-0.5B-Instruct-q4f16_1-MLC

Updated Sep 21, 2024 • 3

Felladrin/gguf-Q5_K_M-Qwen2.5-0.5B-Instruct

Text Generation • Updated Sep 21, 2024 • 32