Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,192

Full-text search

Active filters: GGUF

NexaAIDev/DeepSeek-R1-Distill-Llama-8B-NexaQuant

Updated 4 days ago • 4.4k • 78

NexaAIDev/DeepSeek-R1-Distill-Qwen-1.5B-NexaQuant

Updated 4 days ago • 4.86k • 76

NexaAIDev/OmniVLM-968M

Updated Dec 17, 2024 • 1.69k • 508

tensorblock/r1-1776-GGUF

Updated 2 days ago • 1.66k • 7

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 711 • 52

huihui-ai/r1-1776-GGUF

Updated about 11 hours ago • 104 • 3

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 1.19M • 11

NexaAIDev/Qwen2-Audio-7B-GGUF

Audio-Text-to-Text • Updated Nov 25, 2024 • 10.9k • 144

tensorblock/sexyGPT-Uncensored-GGUF

Updated Dec 18, 2024 • 1.16k • 3

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated 24 days ago • 520k • 2

tensorblock/Tifa-Deepsex-14b-CoT-GGUF

Reinforcement Learning • Updated 16 days ago • 12k • 2

adeebaldkheel/ALLaM-7B-Instruct-preview-reasoning

Text Generation • Updated 2 days ago • 40 • 2

Mozilla/llava-v1.5-7b-llamafile

Updated Aug 19, 2024 • 37.1k • 179

andrijdavid/finance-chat-GGUF

Text Generation • Updated Jan 19, 2024 • 116 • 3

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • Updated Jan 2, 2024 • 266 • 2

tsunemoto/TinyDolphin-2.8-1.1b-GGUF

Updated Jan 22, 2024 • 331 • 8

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 234 • 9

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 190 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 388 • 8

Virt-io/Google-Colab-Imatrix-GGUF

Updated Apr 27, 2024 • 8

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.04M • 74

LiteLLMs/Mixtral-8x22B-v0.1-GGUF

Updated Apr 18, 2024 • 192 • 1

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 94k • 126

LiteLLMs/WizardLM-2-8x22B-GGUF

Updated Apr 18, 2024 • 60 • 4

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 189k • 167

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25, 2024 • 1.44M • 13

LiteLLMs/French-Alpaca-Llama3-8B-Instruct-v1.0-GGUF

Updated May 28, 2024 • 344 • 4

XeTute/AURORA-V1-1.1B-GGUF

Text Generation • Updated 22 days ago • 23 • 4

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.67M • 79

LiteLLMs/aya-23-8B-GGUF

Updated May 28, 2024 • 93 • 2