Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,977

Full-text search

Active filters: awq

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 82.8k • 38

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 1.15k • 20

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 657k • 3

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 93 • 1

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 276 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 39 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 149 • 1

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 61 • 1

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 261k • 97

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 29.1k • 9

solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation • Updated Sep 3, 2024 • 233 • 3

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 70.4k • 46

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 4.87k • 20

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 82.7k • 45

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.82k • 7

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 16.4k • 18

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 16.4k • 15

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 36.8k • 59

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 674k • 57

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 3.17k • 11

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • Updated Sep 20, 2024 • 307 • 2

nimishbongale/phi-3-mini-128k-instruct-cuda-awq-int4-block-32-gemm

Updated Sep 28, 2024 • 3 • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 651 • 4

Orion-zhen/aya-expanse-32b-AWQ

Text Generation • Updated Oct 27, 2024 • 235 • 3

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 13.3k • 22

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated Jan 12 • 25.3k • 6

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated Nov 11, 2024 • 197 • 7

TechxGenus/Mistral-Large-Instruct-2411-AWQ

Updated Nov 19, 2024 • 1.08k • 6

andretisch/llava-saiga-8b-awq

Updated Dec 2, 2024 • 26 • 1

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 1.94k • 23