Edit Models filters

Inference Providers

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Carbon Emissions

Models

24,308

Full-text search

Active filters: 8-bit

NeuML/fasttext-quantized

NeuML/glove-6B-quantized

NeuML/word2vec-quantized

mlx-community/Qwen2.5-7B-Instruct-1M-8bit

Text Generation • Updated 28 days ago • 185 • 1

mlx-community/Qwen2.5-14B-Instruct-1M-8bit

Text Generation • Updated 28 days ago • 487 • 3

m-i/Qwen2.5-14B-DeepSeek-R1-1M-Q8-mlx

Updated 28 days ago • 107 • 2

mlx-community/DeepSeek-R1-Distill-Qwen-32B-Japanese-8bit

Text Generation • Updated 27 days ago • 139 • 2

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q8_0-GGUF

Text Generation • Updated 26 days ago • 73k • 2

Annuvin/YuE-s1-7B-anneal-en-cot-8.0bpw-h8-exl2

Updated 22 days ago • 41 • 1

Alissonerdx/YuE-s1-7B-anneal-en-cot-int8

Updated 21 days ago • 427 • 1

Alissonerdx/YuE-s2-1B-general-int8

Updated 21 days ago • 304 • 1

mlx-community/Mistral-Small-24B-Instruct-2501-8bit

Updated 24 days ago • 444 • 2

mlx-community/Virtuoso-Medium-v2-8bit

Text Generation • Updated 24 days ago • 59 • 1

MaziyarPanahi/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF

Text Generation • Updated 22 days ago • 287 • 1

ReadyArt/L3.3-Damascus-R1_EXl2_8.0bpw_H8

Text Generation • Updated 21 days ago • 64 • 2

BuiDGr8/DeepSeek-R1-Math-114k

Text Generation • Updated 21 days ago • 38 • 1

johannezz/DiffSensei

Updated 18 days ago • 16 • 1

mobiuslabsgmbh/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 17 days ago • 22 • 2

mobiuslabsgmbh/Llama-3.1-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 17 days ago • 65 • 1

mobiuslabsgmbh/Llama-3.2-3B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 17 days ago • 32 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated 17 days ago • 19 • 1

mobiuslabsgmbh/Qwen2.5-14B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated 17 days ago • 14 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 17 days ago • 60 • 2

neuralmagic/DeepSeek-R1-Llama-70B-quantized.w8a8

Updated 16 days ago • 32 • 1