Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-generation-inference

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

124

Full-text search

Active filters: granite-3.1

mradermacher/granite-3.1-1b-a400m-base-GGUF

Updated Dec 21, 2024 • 32

mradermacher/granite-3.1-1b-a400m-instruct-GGUF

Updated Dec 21, 2024 • 121

mradermacher/granite-3.1-2b-base-GGUF

Updated Dec 21, 2024 • 21

mradermacher/granite-3.1-2b-instruct-GGUF

Updated Dec 20, 2024 • 36

mradermacher/granite-3.1-8b-base-GGUF

Updated Dec 20, 2024 • 22

mradermacher/granite-3.1-1b-a400m-base-i1-GGUF

Updated Dec 21, 2024 • 55

mradermacher/granite-3.1-2b-instruct-i1-GGUF

Updated Dec 20, 2024 • 161

mradermacher/granite-3.1-2b-base-i1-GGUF

Updated Dec 21, 2024 • 35

QuantFactory/granite-3.1-8b-base-GGUF

Updated Dec 20, 2024 • 85 • 3

mradermacher/granite-3.1-8b-base-i1-GGUF

Updated Dec 20, 2024 • 58

skarmani/granite-3.1-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Dec 21, 2024 • 11

huihui-ai/granite-3.1-2b-instruct-abliterated

Text Generation • Updated Dec 21, 2024 • 29 • 3

huihui-ai/granite-3.1-8b-instruct-abliterated

Text Generation • Updated Dec 21, 2024 • 29 • 4

mradermacher/granite-3.1-8b-instruct-abliterated-GGUF

Updated Dec 21, 2024 • 244 • 2

mradermacher/granite-3.1-2b-instruct-abliterated-GGUF

Updated Dec 21, 2024 • 110

mradermacher/granite-3.1-2b-instruct-abliterated-i1-GGUF

Updated Dec 21, 2024 • 527

bartowski/granite-3.1-1b-a400m-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 1.41k • 1

itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 13

itlwas/granite-3.1-2b-base-Q4_K_M-GGUF

Updated Dec 23, 2024 • 10

itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 11

itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 11

itlwas/granite-3.1-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 20

itlwas/granite-3.1-1b-a400m-base-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 12

itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 12

itlwas/granite-3.1-8b-base-Q4_K_M-GGUF

Updated Dec 23, 2024 • 14

Novaciano/Granite-3.1-1b-NSFW_Amoral_Christmas-GGUF

Text Generation • Updated Dec 25, 2024 • 32

Triangle104/granite-3.1-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated Dec 25, 2024 • 5

Triangle104/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 25, 2024 • 6

Triangle104/granite-3.1-8b-instruct-Q5_K_S-GGUF

Text Generation • Updated Dec 25, 2024 • 1

Triangle104/granite-3.1-8b-instruct-Q5_K_M-GGUF

Text Generation • Updated Dec 25, 2024 • 4