Edit Models filters

Model Tree

ibm-granite/granite-3.1-8b-instruct

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

31

Full-text search

Active filters: ibm-granite/granite-3.1-8b-instruct

bartowski/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 4.17k • 11

lmstudio-community/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 13.6k • 13

DevQuasar/ibm-granite.granite-3.1-8b-instruct-GGUF

Text Generation • Updated 22 days ago • 234 • 4

mradermacher/granite-3.1-8b-instruct-GGUF

Updated Dec 20, 2024 • 126 • 1

mradermacher/granite-3.1-8b-instruct-i1-GGUF

Updated 11 days ago • 344 • 2

jakiAJK/granite-3.1-8b-instruct_GPTQ-int4

Text Generation • Updated Jan 21 • 198 • 1

neuralmagic/granite-3.1-8b-instruct-FP8-dynamic

Text Generation • Updated 30 days ago • 136 • 1

neuralmagic/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • Updated 24 days ago • 184 • 1

NikolayKozloff/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • Updated Dec 18, 2024 • 8 • 1

jakiAJK/granite-3.1-8b-instruct_AWQ

Text Generation • Updated Jan 21 • 277

itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 12

SandLogicTechnologies/Granite-3.1-8b-instruct-GGUF

Updated Dec 23, 2024 • 22

Triangle104/granite-3.1-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated Dec 25, 2024 • 5

Triangle104/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 25, 2024 • 6

Triangle104/granite-3.1-8b-instruct-Q5_K_S-GGUF

Text Generation • Updated Dec 25, 2024 • 1

Triangle104/granite-3.1-8b-instruct-Q5_K_M-GGUF

Text Generation • Updated Dec 25, 2024 • 4

Triangle104/granite-3.1-8b-instruct-Q6_K-GGUF

Text Generation • Updated Dec 25, 2024 • 3

Triangle104/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • Updated Dec 25, 2024 • 11

tensorblock/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Jan 1 • 77

mindw96/code-granite-8b-text-to-sql-ver0.1

Text Generation • Updated Jan 2 • 11

Alcoft/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Jan 6 • 134

neuralmagic/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • Updated 30 days ago • 119

cgus/granite-3.1-8b-instruct-exl2

Text Generation • Updated Jan 22 • 51

TheMelonGod/granite-3.1-8b-instruct-exl2

Text Generation • Updated 18 days ago • 98

msyukorai/granite-3.1-8b-instruct-Q4_0-GGUF

Text Generation • Updated 14 days ago • 25

ruslanmv/granite-3.1-8b-Reasoning-GGUF

Text Generation • Updated 11 days ago • 63

EasierAI/Granite-3.1-8B

Text Generation • Updated 11 days ago • 82

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 20

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q6_K-GGUF

Text Generation • Updated 6 days ago • 22

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • Updated 6 days ago • 24