Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,030

Full-text search

Active filters: quantized

MaziyarPanahi/HELVETE-X-GGUF

Text Generation • Updated Dec 17, 2024 • 122 • 1

MaziyarPanahi/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v2-GGUF

Text Generation • Updated Dec 20, 2024 • 495 • 2

ktoprakucar/granite-guardian-3.1-2b-Q8-GGUF

Text Generation • Updated Jan 15 • 16 • 1

MaziyarPanahi/WiNGPT-Babel-GGUF

Text Generation • Updated Jan 5 • 78 • 1

MaziyarPanahi/Qwen2.5-Coder-0.5B-QwQ-draft-GGUF

Text Generation • Updated Jan 7 • 260 • 3

MaziyarPanahi/phi-4-GGUF

Text Generation • Updated Jan 8 • 970k • 3

RCDWealth/Dolphin3.0-Qwen2.5-1.5B-Q5_K_M.gguf

Updated Jan 18 • 131 • 1

do-not-use-this-account-token/whisperkit-coreml

Automatic Speech Recognition • Updated Jan 20 • 1.15k • 1

qualcomm/Allam-7B

Text Generation • Updated 9 days ago • 1

MaziyarPanahi/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF

Text Generation • Updated 21 days ago • 287 • 1

MaziyarPanahi/Qwen2.5-14B-Instruct-1M-GGUF

Text Generation • Updated 15 days ago • 279 • 2

ordis-co-ltd/Qwen2.5-VL-72B-Instruct_exl2_6.0bpw

Image-Text-to-Text • Updated 13 days ago • 23 • 1

Atotti/RakutenAI-2.0-mini-instruct-gguf

Updated 11 days ago • 522 • 3

MaziyarPanahi/german-r1-GGUF

Text Generation • Updated 11 days ago • 586 • 1

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • Updated 9 days ago • 171 • 1

MaziyarPanahi/DeepSeek-llama3.1-Bllossom-8B-GGUF

Text Generation • Updated 9 days ago • 623 • 1

MaziyarPanahi/UIGEN-7B-16bit-GGUF

Text Generation • Updated 7 days ago • 125 • 1

MaziyarPanahi/SmolLM2-1.7B-Instruct-16k-GGUF

Text Generation • Updated 1 day ago • 86 • 1

MaziyarPanahi/ALLaM-7B-Instruct-preview-reasoning-GGUF

Text Generation • Updated 1 day ago • 80 • 1

sgedela/opt-125m-quantized

Text Generation • Updated about 15 hours ago • 1

Lewdiculous/InfinityRP-v1-7B-GGUF-IQ-Imatrix

Updated May 4, 2024 • 669 • 44

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2

ravenscroftj/CodeGen-6B-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 9

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 19 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 95 • 1

pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit

Summarization • Updated Jan 21 • 64

ethzanalytics/stablelm-tuned-alpha-7b-sharded-8bit

Text Generation • Updated May 4, 2023 • 12 • 2

rozek/OpenLLaMA_7B_300BT_q4

Text Generation • Updated May 5, 2023 • 1

ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g

Text Generation • Updated May 7, 2023 • 7