Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

909

Full-text search

Active filters: compressed-tensors

Black-Ink-Guild/Pernicious_Prophecy_70B_FP8

Text Generation • Updated 18 days ago • 364

nm-testing/Qwen2-VL-2B-Instruct-Sparse-0.6

Updated 21 days ago • 31

nm-testing/Qwen2-VL-72B-Instruct-quantized.w8a8

Updated 19 days ago • 215

dwetzel/Mistral-Large-Instruct-2411-FP8-Dynamic

Updated 20 days ago • 25

saiscorelabsai/Llama-3.2-3B-Instruct-W8A8-Dynamic-Per-Token

Text Generation • Updated 20 days ago • 8

saiscorelabsai/Llama-3.2-1B-Instruct-W8A8-Dynamic-Per-Token

Text Generation • Updated 20 days ago • 8

saiscorelabsai/Llama-2-13b-chat-W8A8-Dynamic-Per-Token

Text Generation • Updated 20 days ago • 6

kylesayrs/Llama-3.1-8B-Instruct-W4A16-G128

Updated 20 days ago • 13

saiscorelabsai/Phi-3-medium-128k-instruct-W8A8-Dynamic-Per-Token

Text Generation • Updated 20 days ago • 5

neuralmagic/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8

Text Generation • Updated 1 day ago • 1.24k

neuralmagic/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16

Text Generation • Updated 1 day ago • 1.12k

darthhexx/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated 19 days ago • 24

darthhexx/Meta-Llama-3-8B-Instruct-FP8-Dynamic

Text Generation • Updated 19 days ago • 19

neuralmagic/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16

Text Generation • Updated 1 day ago • 1.8k • 2

boboliu/Qwen2.5-14B-Instruct-FP8-KV-CN

Text Generation • Updated 19 days ago • 5

neuralmagic/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

Text Generation • Updated 1 day ago • 1.1k

neuralmagic/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8

Text Generation • Updated 1 day ago • 787 • 1

BigHuggyD/TheDrummer_Anubis-Pro-105B-v1-FP8-Dynamic

Updated 18 days ago • 167

jeffcookio/Qwen2.5-VL-W4A16-G128

Updated 18 days ago • 7

nm-testing/Qwen2.5-VL-3B-Instruct-FP8-Dynamic

Updated 18 days ago • 237

nm-testing/Qwen2.5-VL-7B-Instruct-FP8-Dynamic

Updated 18 days ago • 576

nm-testing/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Updated 18 days ago • 351

mrhendrey/Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 17 days ago • 8

nm-testing/pixtral-12b-W4A16-G128

Updated 17 days ago • 36

saiscorelabsai/phi-4-FP8-Dynamic

Text Generation • Updated 17 days ago • 16

saiscorelabsai/phi-4-W8A8-Dynamic-Per-Token-with-Smoothing

Text Generation • Updated 17 days ago • 33

neuralmagic/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • Updated 1 day ago • 1.54k • 2

neuralmagic/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16

Text Generation • Updated 1 day ago • 872

SicariusSicariiStuff/Redemption_Wind_24B_FP8

Updated 17 days ago • 13

nm-testing/Pixtral-Large-Instruct-2411-hf-quantized.w4a16

Updated 16 days ago • 249