Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

11,290

Full-text search

Active filters: imatrix

arcee-ai/Arcee-Maestro-7B-Preview-GGUF

Updated 3 days ago • 926 • 2

mradermacher/Dans-PersonalityEngine-V1.2.0-24b-i1-GGUF

Updated 2 days ago • 621 • 2

mradermacher/miscii-14b-0218-i1-GGUF

Updated about 13 hours ago • 1.34k • 2

mradermacher/Midnight-Rose-70B-v2.0.3-i1-GGUF

Updated May 10, 2024 • 375 • 1

Lewdiculous/LemonadeRP-4.5.3-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 184 • 13

dranger003/c4ai-command-r-plus-iMat.GGUF

Text Generation • Updated May 6, 2024 • 1.58k • 139

backyardai/WizardLM-2-8x22B-GGUF

Updated May 22, 2024 • 251 • 1

qwp4w3hyb/Not-WizardLM-2-8x22B-iMat-GGUF

Updated Apr 21, 2024 • 182 • 3

mradermacher/Llama-3-8B-Ultra-Instruct-i1-GGUF

Updated Dec 16, 2024 • 152 • 2

bartowski/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Jun 30, 2024 • 80.5k • 49

bartowski/Llama-3-ChatQA-1.5-8B-GGUF

Text Generation • Updated May 2, 2024 • 450 • 42

mradermacher/Llama-3-Soliloquy-8B-v2-i1-GGUF

Updated 2 days ago • 367 • 5

bartowski/35b-beta-long-GGUF

Text Generation • Updated May 6, 2024 • 9.76k • 27

mmnga/Fugaku-LLM-13B-instruct-gguf

Updated May 12, 2024 • 1.41k • 5

backyardai/Midnight-Rose-70B-v2.0.3-GGUF

Updated May 22, 2024 • 1.17k • 4

Lewdiculous/llama-3-cat-8b-instruct-v1-GGUF-IQ-Imatrix

Updated May 13, 2024 • 284 • 18

bartowski/llama-3-70B-Instruct-abliterated-GGUF

Text Generation • Updated May 16, 2024 • 392 • 6

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

Updated Sep 3, 2024 • 1.28k • 93

SakuraLLM/GalTransl-7B-v2.6

Updated Oct 4, 2024 • 4.69k • 31

bartowski/aya-23-35B-GGUF

Text Generation • Updated May 23, 2024 • 1.98k • 27

bartowski/Codestral-22B-v0.1-GGUF

Text Generation • Updated Jun 5, 2024 • 9.65k • 184

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated Dec 12, 2024 • 585 • 23

qwp4w3hyb/Codestral-22B-v0.1-iMat-GGUF

Text Generation • Updated Jun 1, 2024 • 443 • 3

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated Oct 2, 2024 • 2.96k • 24

Lewdiculous/Hathor-L3-8B-v.01-GGUF-IQ-Imatrix

Updated Jun 7, 2024 • 225 • 8

mradermacher/Llama-3-Luminurse-v0.2-OAS-8B-i1-GGUF

Updated 16 days ago • 505 • 1

bartowski/L3-70B-Euryale-v2.1-GGUF

Text Generation • Updated Jun 13, 2024 • 499 • 14

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imat-plus2

Text Generation • Updated Nov 14, 2024 • 1.19k • 7

bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 114k • 99

CISCai/DeepSeek-Coder-V2-Lite-Instruct-SOTA-GGUF

Updated Jun 17, 2024 • 762 • 2