Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

19

Base only

Active filters: fp8-kv-cache

AEON-7/Qwen3.6-35B-A3B-heretic-NVFP4

Image-Text-to-Text • 21B • Updated Jul 15 • 380k • 63

namgyu-youn/EXAONE-4.0-1.2B-LLMC-AWQ-W4

1B • Updated Feb 18 • 10

rhoninseiei/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-ModelOpt-NVFP4

Image-Text-to-Text • 17B • Updated Mar 21 • 10 • 1

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated Jul 15 • 10.7k • 22

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 18B • Updated Jul 15 • 8.66k • 13

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated Jul 15 • 185 • 2

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 17B • Updated Jun 28 • 159 • 2

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 15B • Updated Jul 15 • 196 • 6

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated Jun 21 • 105k • 1

AEON-7/Gemma-4-E4B-it-Uncensored-NVFP4

Text Generation • 6B • Updated Jul 15 • 359 • 3

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-Uncensored-NVFP4

Text Generation • 6B • Updated Jul 15 • 157 • 1

AEON-7/gemma-4-31B-it-speculator.eagle3-NVFP4

Text Generation • 2B • Updated Jun 21 • 433 • 5

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated Jul 15 • 3.54k • 9

murilonwt/granite-4.1-8b-NVFP4

Text Generation • 5B • Updated May 19 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4

Text Generation • 8B • Updated Jul 15 • 206 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4-FP8

Text Generation • 8B • Updated Jul 15 • 3.36k

amanwalksdownthestreet/Hermes-4-70B-MXFP8-KV8

Text Generation • 73B • Updated Jul 3 • 16

spellbound-eng/hy3-spellbound-simpo-step151-nvfp4-c8

170B • Updated Jul 9

Ishowbackup/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 18B • Updated 2 days ago • 7