Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

544

Base only

Active filters: w4a16

huginnfork/Qwen3.8-27B-NVFP4A16

Image-Text-to-Text • 28B • Updated about 3 hours ago • 15

jcbtc/Ling-3.0-Flash-CIRU-int4-Strix-native

Text Generation • 127B • Updated 4 days ago • 181 • 8

baicai1145/DeepSeek-V4-Flash-0731-W4A16

Text Generation • 45B • Updated 10 days ago • 766 • 7

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 1.12M • 132

LeaderboardModel1/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-AutoRound-W4A16-Tuning

Text Generation • 6B • Updated 14 days ago • 335 • 3

goldhub/Qwen3.6-40B-Fable-Fusion-6-Core-Deckard-Eleanor-Heretic-Uncensored-W4A16-AutoRound

Text Generation • 15B • Updated about 16 hours ago • 3

kkuspa/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-NVFP4A16

Image-Text-to-Text • 27B • Updated 14 days ago • 10.9k • 8

useful-quants/GLM-4.6V-Flash-W4A16-BF16Vision

Image-Text-to-Text • 10B • Updated Jun 18 • 33 • 2

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 17.3k • 19

coolthor/gemma-4-12B-it-NVFP4A16

Any-to-Any • 7B • Updated Jun 5 • 2.39k • 1

sakamakismile/gemma-4-12B-coder-fable5-composer2.5-MTP-NVFP4

Text Generation • 7B • Updated Jun 16 • 1.27k • 50

quant-mind/Huihui-Qwen3-VL-8B-Instruct-abliterated-AWQ-int4

Image-Text-to-Text • 9B • Updated Jun 18 • 129 • 1

philbert440/Qwen3.6-27B-Uncensored-Cyber-W4A16-AWQ

Image-Text-to-Text • 27B • Updated 12 days ago • 1.66k • 4

ajh-code/chatterbox-flash-t3-w4a16-nvfp4

Text-to-Speech • Updated 15 days ago • 26 • 1

LeaderboardModel1/ThinkingCap-Qwen3.6-27B-AutoRound-W4A16-Tuning

Text Generation • 3B • Updated Jul 13 • 3.48k • 3

DoktorMincs/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-W4A16-AutoRound

28B • Updated 17 days ago • 4.93k • 2

groxaxo/Nemotron-3-Embed-8B-AWQ-W4A16-G32-ASYM

Feature Extraction • 8B • Updated 12 days ago • 90 • 2

useful-quants/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-W4A16

Text Generation • 32B • Updated about 17 hours ago • 97 • 1

RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic

Image-Text-to-Text • 73B • Updated Mar 31, 2025 • 28

RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16

141B • Updated 9 days ago • 36

RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16

47B • Updated 9 days ago • 183

RedHatAI/QwQ-32B-Preview-quantized.w4a16

33B • Updated 9 days ago • 37

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation • 71B • Updated 9 days ago • 239

RedHatAI/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • 8B • Updated 9 days ago • 1.18k • 1

RedHatAI/granite-3.1-2b-instruct-quantized.w4a16

Text Generation • 3B • Updated 9 days ago • 25.3k

RedHatAI/DeepSeek-V2.5-1210-quantized.w4a16

Text Generation • 238B • Updated Jan 11, 2025 • 29

RedHatAI/DeepSeek-Coder-V2-Instruct-0724-quantized.w4a16

Text Generation • 238B • Updated Jan 12, 2025 • 33 • 1

RedHatAI/granite-3.1-2b-base-quantized.w4a16

Text Generation • 3B • Updated 9 days ago • 255

RedHatAI/granite-3.1-8b-base-quantized.w4a16

Text Generation • 8B • Updated 9 days ago • 262 • 1

RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16

Image-Text-to-Text • 73B • Updated 9 days ago • 45