Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,873

Full-text search

Active filters: 4-bit

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 3.45k • 24

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 6.26k • 16

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 1.53k • 12

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 7 days ago • 26.6k • 50

mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit

Text Generation • Updated Jan 21 • 502k • 34

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 8 days ago • 217k • 98

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 7 days ago • 8.24k • 26

prithivMLmods/Blaze.1-7B-Vision

Image-Text-to-Text • Updated Jan 15 • 288 • 7

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • Updated 8 days ago • 53.9k • 22

Benasd/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 15 days ago • 1.95k • 6

Benasd/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 3 days ago • 23.1k • 7

arcee-ai/Arcee-Blitz-AWQ

Text Generation • Updated 2 days ago • 148 • 4

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 711 • 52

internlm/internlm3-8b-instruct-gptq-int4

Text Generation • Updated Jan 15 • 330 • 3

unsloth/DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 3.35k • 6

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 19.1k • 17

unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 3.09k • 6

mlx-community/DeepSeek-R1-Distill-Qwen-32B-abliterated-4bit

Text Generation • Updated 3 days ago • 67 • 3

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.03k • 576

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 111k • 196

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 135k • 21

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 1.19M • 11

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated Jan 7 • 108k • 35

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 85.3k • 41

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 62.6k • 9

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 222k • 19

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated Jan 20 • 47.9k • 15

unsloth/DeepSeek-R1-Distill-Qwen-32B-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 3.47k • 9

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated 24 days ago • 520k • 2

unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

Text Generation • Updated 21 days ago • 18.3k • 12