Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,320

Full-text search

Active filters: gptq

jakiAJK/granite-3.1-8b-instruct_GPTQ-int4

Text Generation • Updated Jan 21 • 198 • 1

shuyuej/c4ai-command-r-v01-GPTQ

Updated Dec 22, 2024 • 11 • 1

OPEA/deepseek-vl2-int4-sym-gptq-inc

Updated Jan 6 • 343 • 5

ModelCloud/QwQ-32B-Preview-gguf-vortex-v1

Text Generation • Updated Dec 26, 2024 • 13 • 2

Jimmy1229/Llama-3.2-1B-4bit

Text Generation • Updated Dec 30, 2024 • 22 • 1

huihui-ai/QVQ-72B-Preview-abliterated-GPTQ-Int4

Image-Text-to-Text • Updated Dec 31, 2024 • 54 • 1

OPEA/DeepSeek-V3-int4-sym-gptq-inc

Updated 12 days ago • 649 • 15

Satwik11/Microsoft-phi-4-Instruct-AutoRound-GPTQ-4bit

Updated Jan 10 • 321 • 1

fbaldassarri/meta-llama_Llama-3.2-3B-auto_round-int8-gs128-sym

Text Generation • Updated Jan 9 • 14 • 1

nejumi/phi-4-GPTQ-Int4-calib-ja-1k

Updated Jan 21 • 153 • 3

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • Updated Jan 22 • 15.8k • 38

ModelCloud/Qwen2.5-0.5B-Instruct-gptqmodel-4bit

Text Generation • Updated Jan 16 • 66 • 1

jakiAJK/DeepSeek-R1-Distill-Qwen-7B_GPTQ-int4

Text Generation • Updated Jan 21 • 675 • 2

kaitchup/DeepSeek-R1-Distill-Qwen-7B-AutoRound-GPTQ-4bit

Text Generation • Updated 28 days ago • 355 • 1

kaitchup/DeepSeek-R1-Distill-Llama-8B-AutoRound-GPTQ-4bit

Text Generation • Updated 28 days ago • 233 • 1

kaitchup/DeepSeek-R1-Distill-Qwen-14B-AutoRound-GPTQ-4bit

Text Generation • Updated 28 days ago • 972 • 5

nejumi/DeepSeek-R1-Distill-Qwen-32B-GPTQ-Int4-calib-ja-1k

Updated Jan 22 • 282 • 2

jakiAJK/DeepSeek-R1-Distill-Qwen-1.5B_GPTQ-int4

Text Generation • Updated Jan 22 • 562 • 1

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v1

Text Generation • Updated Jan 24 • 533 • 5

adriabama06/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-8bit

Text Generation • Updated Jan 22 • 675 • 1

avoroshilov/DeepSeek-R1-Distill-Qwen-14B-GPTQ_4bit-128g

Text Generation • Updated 30 days ago • 295 • 1

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2

Text Generation • Updated Jan 24 • 741 • 5

kaitchup/Mistral-Small-24B-Instruct-2501-AutoRound-GPTQ-4bit

Updated 20 days ago • 145 • 1

rinna/qwen2.5-bakeneko-32b-instruct-gptq-int8

Text Generation • Updated 10 days ago • 49 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-GPTQ-W4A16

Text Generation • Updated 10 days ago • 26 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-GPTQ-W8A8

Text Generation • Updated 10 days ago • 22 • 1

OPEA/DeepSeek-R1-int2-gptq-sym-inc

Updated 7 days ago • 25 • 2

empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit

Text Generation • Updated 8 days ago • 129 • 2

TheBloke/Nete-13B-GPTQ

Text Generation • Updated Oct 27, 2023 • 56 • 6

TheBloke/Utopia-13B-GPTQ

Text Generation • Updated Nov 5, 2023 • 99 • 12