Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,316

Full-text search

Active filters: gptq

TheBloke/merlyn-education-corpus-qa-v2-GPTQ

Text Generation • Updated Nov 16, 2023 • 29 • 3

TheBloke/merlyn-education-safety-GPTQ

Text Generation • Updated Nov 16, 2023 • 61 • 3

TheBloke/saiga_mistral_7b-GPTQ

Text Generation • Updated Nov 28, 2023 • 323 • 8

TheBloke/deepseek-llm-67b-chat-GPTQ

Text Generation • Updated Nov 29, 2023 • 160 • 7

TheBloke/deepseek-llm-7B-chat-GPTQ

Text Generation • Updated Nov 30, 2023 • 858 • 1

Qwen/Qwen-1_8B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 564 • 34

AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct-4bit-gptq

Text Generation • Updated Jan 7 • 50 • 6

Pi3141/alpaca-7b-native-enhanced-GPTQ

Text Generation • Updated Dec 3, 2023 • 2

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 204 • 111

TheBloke/GEITje-7B-chat-GPTQ

Text Generation • Updated Dec 19, 2023 • 38 • 4

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 3.25k • 25

IntelLabs/sqft-phi-3-mini-4k-50-base-gptq

Text Generation • Updated 11 days ago • 305 • 2

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10, 2024 • 1.25k • 18

allganize/Llama-3-Alpha-Ko-8B-Instruct-marlin

Text Generation • Updated May 24, 2024 • 32 • 5

cortecs/Mistral-7B-Instruct-v0.3-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 229 • 1

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 2.11k • 24

IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq

Text Generation • Updated 11 days ago • 232 • 2

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18, 2024 • 793 • 4

AI-MO/NuminaMath-7B-TIR-GPTQ

Text Generation • Updated Jul 9, 2024 • 374 • 7

pentagoniac/SEMIKONG-8b-GPTQ

Text Generation • Updated Jul 9, 2024 • 600 • 26

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 1.82k • 4

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ

Text Generation • Updated Jul 25, 2024 • 13.1k • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 11.1k • 22

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated Dec 17, 2024 • 534k • 24

IntelLabs/sqft-qa-sparsepeft-mistral-7b-v0.3-50-gptq-gsm8k-heu

Text Generation • Updated 11 days ago • 160 • 2

IntelLabs/sqft-qa-sparsepeft-mistral-7b-v0.3-50-gptq-math-heu

Text Generation • Updated 11 days ago • 86 • 1

IntelLabs/sqft-qa-sparsepeft-phi-3-mini-4k-50-gptq-math-heu

Text Generation • Updated 11 days ago • 88 • 2

IntelLabs/sqft-qa-sparsepeft-phi-3-mini-4k-50-gptq-cs-heu

Text Generation • Updated 11 days ago • 229 • 2

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21, 2024 • 131k • 34

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21, 2024 • 5.1k • 28