Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

457

Full-text search

Active filters: vllm

Hasso5703/Mistral-Small-24B-Instruct-2501-Q4_0-GGUF

Updated 24 days ago • 196 • 2

Hasso5703/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated 24 days ago • 20 • 1

Triangle104/Mistral-Small-24B-Instruct-2501-Q5_K_S-GGUF

Updated 24 days ago • 29 • 1

lolnoyarite/Mistral-Small-24B-Base-2501-Q4_K_M-GGUF

Updated 24 days ago • 305 • 1

IntervitensInc/Mistral-Small-24B-Instruct-2501-chatml

Text Generation • Updated 21 days ago • 1.81k • 1

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 24 days ago • 24.7k • 11

matatonic/Mistral-Small-24B-Instruct-2501-5.0bpw-exl2

Text Generation • Updated 24 days ago • 39 • 1

nm-testing/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated 22 days ago • 944 • 3

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_4bpw_H8

Text Generation • Updated 24 days ago • 77 • 1

neuralmagic/whisper-large-v2-W4A16-G128

Automatic Speech Recognition • Updated 23 days ago • 36 • 1

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q4_K_M-GGUF

Updated 23 days ago • 74 • 1

huihui-ai/Mistral-Small-24B-Instruct-2501-abliterated

Text Generation • Updated 21 days ago • 1.19k • 8

neuralmagic/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic

Text Generation • Updated about 21 hours ago • 1.09k • 1

neuralmagic/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic

Text Generation • Updated about 21 hours ago • 984 • 1

darkc0de/Mistral-Small-24B-Instruct-2501-abliterated-Q4_K_M-GGUF

Updated 21 days ago • 1.36k • 1

neuralmagic/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16

Text Generation • Updated about 21 hours ago • 834 • 1

newme/Oscar_Lorastral_8b

Updated 12 days ago • 5 • 1

Zhihui/CTRL-32B

Text Generation • Updated 6 days ago • 50 • 3

SistInf/Velvet-14B-GGUF

Updated 11 days ago • 458 • 6

SistInf/Velvet-2B-GGUF

Updated 11 days ago • 235 • 4

merterbak/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

Updated 11 days ago • 55 • 1

NikolayKozloff/DeepHermes-3-Llama-3-8B-Preview-Q8_0-GGUF

Updated 10 days ago • 24 • 1

Hasso5703/Mistral-Small-24B-Base-2501-Q2_K-GGUF

Updated 10 days ago • 5 • 1

mradermacher/DeepHermes-3-Llama-3-8B-Preview-GGUF

Updated 10 days ago • 592 • 2

mradermacher/DeepHermes-3-Llama-3-8B-Preview-i1-GGUF

Updated 10 days ago • 933 • 2

Hasso5703/Mistral-Small-24B-Base-2501-Q4_0-GGUF

Updated 9 days ago • 29 • 1

Triangle104/DeepHermes-3-Llama-3-8B-Preview-Q4_K_M-GGUF

Updated 9 days ago • 9 • 1

nm-testing/whisper-large-v3.w4a16

Automatic Speech Recognition • Updated 9 days ago • 8 • 1

tinybiggames/DeepHermes-3-Llama-3-8B-Preview-Q4_K_M-GGUF

Updated 9 days ago • 54 • 2

ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501

Text Generation • Updated 7 days ago • 159 • 3