Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,789

Base only

Active filters: exl3

MikeRoz/Electranova-70B-v1.0-exl3

Updated Sep 29, 2025 • 1

isogen/reka-flash-3-exl3-3bpw

5B • Updated Jun 22, 2025 • 6

LatentWanderer/THUDM_GLM-4-32B-0414-6.5bpw-h8-exl3

Text Generation • 14B • Updated Apr 22, 2025 • 12

isogen/reka-flash-3-exl3-4bpw

6B • Updated Jun 22, 2025 • 5

LatentWanderer/THUDM_GLM-4-9B-0414-6.5bpw-h8-exl3

Text Generation • 4B • Updated Apr 25, 2025 • 16

isogen/Mistral-Nemo-Instruct-2407-exl3-6bpw

5B • Updated Jun 22, 2025 • 8

isogen/Mistral-Nemo-Instruct-2407-exl3-4bpw

4B • Updated Jun 22, 2025 • 6

turboderp/c4ai-command-r-08-2024-exl3

Updated Nov 1, 2025 • 33 • 6

Panchovix/Llama-3_1-Nemotron-Ultra-253B-v1-3.6bpw-h6-exl3

Text Generation • 59B • Updated Apr 27, 2025 • 8

Panchovix/Llama-3_1-Nemotron-Ultra-253B-v1-3.25bpw-h6-exl3

Text Generation • 54B • Updated Apr 27, 2025 • 11

turboderp/c4ai-command-r7b-12-2024-exl3

Updated Nov 1, 2025 • 31 • 1

Downtown-Case/nbeerbower_EVA-Gutenberg3-Qwen2.5-32B-exl3-4.0bpw-hb8

Text Generation • 9B • Updated Apr 28, 2025 • 12

Panchovix/Llama-3_1-Nemotron-Ultra-253B-v1-3.45bpw-h6-exl3

Text Generation • 57B • Updated Apr 28, 2025 • 9 • 1

turboderp/Qwen3-0.6B-exl3

Updated Nov 1, 2025 • 44 • 2

LatentWanderer/Qwen_Qwen3-0.6B-6.5bpw-h8-exl3

Text Generation • 0.4B • Updated Apr 29, 2025 • 15

isogen/Mistral-Small-3.1-24B-Instruct-2503-exl3-3bpw

5B • Updated Jun 22, 2025 • 10

isogen/Mistral-Small-3.1-24B-Instruct-2503-exl3-4bpw

6B • Updated Jun 22, 2025 • 6

LatentWanderer/Qwen_Qwen3-32B-6.5bpw-h8-exl3

Text Generation • 14B • Updated Apr 30, 2025 • 8 • 3

turboderp/Qwen3-32B-exl3

Updated Nov 1, 2025 • 53 • 19

Jellon/QwQ-32B-ArliAI-RpR-v3-exl3-3bpw

7B • Updated Apr 30, 2025 • 8

Jellon/QwQ-32B-ArliAI-RpR-v3-exl3-4bpw

9B • Updated Apr 30, 2025 • 7

Downtown-Case/Qwen_Qwen3-32B-exl3-3.45bpw-hb8

Text Generation • 8B • Updated Apr 30, 2025 • 12

turboderp/Qwen3-8B-exl3

Updated Nov 1, 2025 • 85 • 5

bullerwins/Qwen3-32B-exl3-3.50bpw

Text Generation • 8B • Updated May 1, 2025 • 11

bullerwins/Qwen3-32B-exl3-3.63bpw

Text Generation • 8B • Updated May 1, 2025 • 13

bullerwins/Qwen3-32B-exl3-4.83bpw

Text Generation • 10B • Updated May 1, 2025 • 12 • 1

DanyDA/Qwen3-32B-exl3-2.0bpw

Text Generation • 5B • Updated May 2, 2025 • 12

DanyDA/Qwen3-32B-exl3-4.0bpw

Text Generation • 9B • Updated May 2, 2025 • 9

isogen/Qwen3-14B-exl3-4bpw

4B • Updated May 12, 2025 • 16

isogen/Qwen3-14B-exl3-6bpw

6B • Updated May 12, 2025 • 16