Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,874

Full-text search

Active filters: 4-bit

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 2.75k • 24

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 5.87k • 16

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 1.25k • 12

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 7 days ago • 26.4k • 50

mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit

Text Generation • Updated Jan 21 • 491k • 34

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 8 days ago • 219k • 98

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 7 days ago • 8.26k • 26

prithivMLmods/Blaze.1-7B-Vision

Image-Text-to-Text • Updated Jan 15 • 301 • 7

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • Updated 8 days ago • 53.3k • 22

Benasd/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 15 days ago • 1.91k • 6

Benasd/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 3 days ago • 23k • 7

arcee-ai/Arcee-Blitz-AWQ

Text Generation • Updated 2 days ago • 124 • 4

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 676 • 52

internlm/internlm3-8b-instruct-gptq-int4

Text Generation • Updated Jan 15 • 334 • 3

unsloth/DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 3.28k • 6

unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 2.79k • 6

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 1.04k • 576

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 110k • 196

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 157k • 21

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 1.13M • 11

unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 80.5k • 23

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated Jan 7 • 122k • 35

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 84.9k • 41

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 58k • 9

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 210k • 19

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated Jan 20 • 42.6k • 15

unsloth/DeepSeek-R1-Distill-Qwen-32B-unsloth-bnb-4bit

Text Generation • Updated 8 days ago • 3.41k • 9

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated 24 days ago • 468k • 2

unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

Text Generation • Updated 21 days ago • 17.6k • 12

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 18.7k • 16