Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

457

Full-text search

Active filters: vllm

ClausQ-dk/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated 16 days ago • 25

neuralmagic/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • Updated about 21 hours ago • 1.41k • 2

neuralmagic/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16

Text Generation • Updated about 21 hours ago • 862

owao/Mistral-Small-24B-Instruct-2501-Q5_K_M-GGUF

Updated 16 days ago • 17

lukasfast/Ministral-8B-Instruct-2410-Q4_K_M-GGUF

Updated 15 days ago • 28

lukasfast/Ministral-8B-Instruct-2410-Q8_0-GGUF

Updated 15 days ago • 37

lukasfast/Ministral-8B-Instruct-2410-Q6_K-GGUF

Updated 15 days ago • 27

lucyknada/Almawave_Velvet-14B-exl2

Updated 14 days ago • 1

Lucy-in-the-Sky/Ministral-8B-Instruct-2410-Q2_K-GGUF

Updated 14 days ago • 26

Lucy-in-the-Sky/Ministral-8B-Instruct-2410-Q4_K_M-GGUF

Updated 14 days ago • 12

Lucy-in-the-Sky/Ministral-8B-Instruct-2410-Q6_K-GGUF

Updated 14 days ago • 10

Lucy-in-the-Sky/Ministral-8B-Instruct-2410-Q8_0-GGUF

Updated 14 days ago • 14

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q5_K_M-GGUF

Updated 14 days ago • 19

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q6_K-GGUF

Updated 14 days ago • 45

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q8_0-GGUF

Updated 14 days ago • 44

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_4.5bpw_H8

Text Generation • Updated 12 days ago • 32

roleplaiapp/mistralai_Mistral-Small-Instruct-2409-exl2-2.5bpw

Updated 12 days ago • 6

roleplaiapp/mistralai_Mistral-Small-Instruct-2409-exl2-3.0bpw

Updated 12 days ago • 5

roleplaiapp/mistralai_Mistral-Small-Instruct-2409-exl2-1.5bpw

Updated 12 days ago • 14

roleplaiapp/mistralai_Mistral-Small-Instruct-2409-exl2-2.0bpw

Updated 12 days ago • 7

roleplaiapp/mistralai_Mistral-Small-Instruct-2409-exl2-0.5bpw

Updated 11 days ago • 5

EliasOenal/Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic

Text Generation • Updated 11 days ago

neuralmagic/Llama-3.2-11B-Vision-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 10 days ago • 61

adriabama06/DeepScaleR-1.5B-Preview-GPTQ-8bit

Updated about 6 hours ago • 46 • 1

waustin/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

Updated 10 days ago • 10

mlx-community/DeepHermes-3-Llama-3-8B-Preview-4Bit

Text Generation • Updated 10 days ago • 96

maxrubin629/DeepHermes-3-Llama-3-8B-Preview-Q4-mlx

Text Generation • Updated 10 days ago • 8

maxrubin629/DeepHermes-3-Llama-3-8B-Preview-6bit

Text Generation • Updated 7 days ago • 22

tensorblock/DeepHermes-3-Llama-3-8B-Preview-GGUF

Updated 10 days ago • 1k

Triangle104/DeepHermes-3-Llama-3-8B-Preview-Q4_K_S-GGUF

Updated 9 days ago • 6