Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

33

Base only

Active filters: ampere

useful-quants/GLM-4.6V-Flash-W4A16-BF16Vision

Image-Text-to-Text • 10B • Updated Jun 18 • 33 • 2

useful-quants/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-W4A16

Text Generation • 32B • Updated 2 days ago • 353 • 1

Jon-Nielsen/DeepSeek-V4-Flash-0731-MXFP4-INT8

Text Generation • 159B • Updated about 15 hours ago • 1

imgailab/sdxl-trtx-bf16-ampere

Updated Aug 12, 2025 • 5

imgailab/flux1-schnell-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

imgailab/flux1-dev-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

imgailab/sdxl-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

Winnougan/LTX-2.3-INT8

Updated Jun 27 • 21

sch0tten/Qwen3.5-27B-research-AWQ

Text Generation • 10B • Updated Jun 12 • 1.04k • 2

pranay5255/flash-attn-v2-ampere

Updated Apr 14 • 1

useful-quants/InternVL3_5-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 5B • Updated Apr 30 • 187

useful-quants/Mistral-NeMo-Minitron-8B-Instruct-W4A16

Text Generation • 8B • Updated Apr 30 • 12

useful-quants/Phi-4-mini-instruct-W4A16

Text Generation • 4B • Updated Apr 30 • 13

useful-quants/Qwen3-4B-Instruct-2507-W4A16-G128

Text Generation • 4B • Updated May 6 • 12

useful-quants/Qwen3-VL-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 4B • Updated May 7 • 13

mattbucci/gemma-4-21B-REAP-AWQ

Image-Text-to-Text • 26B • Updated May 10 • 4

useful-quants/Ministral-3-3B-Instruct-2512-W4A16-BF16Vision

Text Generation • 4B • Updated Jun 11 • 11

aidendle94/diffusiongemma-26B-A4B-it-INT8-dynamic

Text Generation • 26B • Updated Jun 12 • 665 • 3

thad0ctor/torch2.12-cu133-cp312-wheels

Updated Jun 15 • 4

aleada/Pixtral-12B-W4A16

Image-Text-to-Text • 13B • Updated 4 days ago • 140 • 1

aleada/Llama-3.2-11B-Vision-Instruct-W4A16

Image-Text-to-Text • 11B • Updated 4 days ago • 138

aleada/Phi-4-mini-instruct-W4A16

Text Generation • 4B • Updated 4 days ago • 358

aleada/SmolLM3-3B-W4A16

Text Generation • 3B • Updated 4 days ago • 314

aleada/Phi-4-W4A16

Text Generation • 15B • Updated 4 days ago • 309

aleada/Gemma-3-12B-it-W4A16

Image-Text-to-Text • 12B • Updated 4 days ago • 47

Winnougan/Wan2.2-INT8-Convrot

Updated Jul 1 • 32

Israeli-AI/DeepSeek-v4-flash-180b-W4A16-VOLTA-Ampere

Text Generation • 182B • Updated Jul 15 • 5.51k • 1

Relativ3pa1n/Laguna-S-2.1-W4A16

Text Generation • 22B • Updated 22 days ago • 120 • 1

Relativ3pa1n/Laguna-S-2.1-W8A16

Text Generation • 36B • Updated 22 days ago • 54

hsmin92/internvl35-fp8

Image-Text-to-Text • 5B • Updated 9 days ago • 55