Models

unsloth/gpt-oss-20b-unsloth-bnb-4bit

Text Generation • 21B • Updated 13 days ago • 88.4k • 16

Intel/GLM-4.5V-int4-AutoRound

2B • Updated 6 days ago • 76 • 6

helizac/dots.ocr-4bit

Image-to-Text • 2B • Updated 15 days ago • 588 • 8

InferenceIllusionist/gpt-oss-20b-MLX-4bit

21B • Updated 15 days ago • 3.83k • 11

mlx-community/gemma-3-270m-it-4bit

Text Generation • 0.0B • Updated 6 days ago • 660 • 5

QuantTrio/GLM-4.5V-AWQ

Image-Text-to-Text • 17B • Updated 9 days ago • 1.07k • 13

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 2B • Updated Jun 2 • 43k • 27

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • 1B • Updated Apr 6 • 427k • 49

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit

Text Generation • 31B • Updated 21 days ago • 541k • 5

unsloth/gpt-oss-20b-bnb-4bit

Text Generation • 21B • Updated 15 days ago • 39.8k • 10

unsloth/gemma-3-270m-it-bnb-4bit

Text Generation • 0.2B • Updated 7 days ago • 1.32k • 3

Intel/GLM-4.5-int4-mixed-AutoRound

Text Generation • Updated 6 days ago • 39 • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 237k • 75

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • 13B • Updated Mar 7 • 21.9k • 62

unsloth/Phi-4-mini-instruct-bnb-4bit

Text Generation • 2B • Updated 21 days ago • 1.89k • 2

Qwen/Qwen3-32B-AWQ

Text Generation • 6B • Updated May 21 • 504k • 100

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 5B • Updated May 21 • 46.2k • 24

inferencerlabs/Kimi-K2-Instruct-MLX-3.985bit

Text Generation • 1T • Updated 24 days ago • 2.05k • 4

Intel/gpt-oss-20b-int4-AutoRound

2B • Updated 14 days ago • 5.64k • 5

mlx-community/gpt-oss-120b-4bit

Text Generation • 117B • Updated 15 days ago • 402 • 3

unsloth/Qwen3-4B-Instruct-2507-unsloth-bnb-4bit

Text Generation • 3B • Updated 14 days ago • 17.6k • 3

xiangxinai/Xiangxin-Guardrails-Text

Text Classification • 3B • Updated about 1 hour ago • 84 • 3

lmstudio-community/gemma-3-270m-it-qat-MLX-4bit

Text Generation • 0.1B • Updated 7 days ago • 2.83k • 2

lmstudio-community/gemma-3-270m-it-MLX-4bit

Text Generation • 0.1B • Updated 7 days ago • 1.48k • 2

mlx-community/DeepSeek-V3.1-Base-4bit

Text Generation • 671B • Updated about 21 hours ago • 281 • 2

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 4B • Updated Sep 27, 2023 • 1.16k • 581

TheBloke/wizard-vicuna-13B-AWQ

Text Generation • 2B • Updated Nov 9, 2023 • 16 • 2

TheBloke/deepseek-llm-67b-chat-GPTQ

Text Generation • 10B • Updated Nov 29, 2023 • 109 • 8

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • 6B • Updated Dec 14, 2023 • 303k • 138

unsloth/llama-2-13b-bnb-4bit

Text Generation • 7B • Updated Sep 3, 2024 • 2.05k • 6