Edit Models filters

Model Tree

ibm-granite/granite-3.1-8b-base

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

18

Full-text search

Active filters: ibm-granite/granite-3.1-8b-base

DevQuasar/ibm-granite.granite-3.1-8b-base-GGUF

Text Generation • Updated 22 days ago • 139 • 1

ticlazau/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 21

QuantFactory/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 517 • 7

mradermacher/granite-3.1-8b-base-GGUF

Updated Dec 20, 2024 • 22

mradermacher/granite-3.1-8b-base-i1-GGUF

Updated Dec 20, 2024 • 58

itlwas/granite-3.1-8b-base-Q4_K_M-GGUF

Updated Dec 23, 2024 • 14

tensorblock/granite-3.1-8b-base-GGUF

Updated Jan 1 • 39

Triangle104/granite-3.1-8b-base-Q4_K_S-GGUF

Updated Jan 12 • 7

Triangle104/granite-3.1-8b-base-Q4_K_M-GGUF

Updated Jan 12 • 9

Triangle104/granite-3.1-8b-base-Q5_K_S-GGUF

Updated Jan 12 • 15

Triangle104/granite-3.1-8b-base-Q5_K_M-GGUF

Updated Jan 12 • 4

Triangle104/granite-3.1-8b-base-Q6_K-GGUF

Updated Jan 12 • 7

Triangle104/granite-3.1-8b-base-Q8_0-GGUF

Updated Jan 12 • 68

neuralmagic/granite-3.1-8b-base-quantized.w8a8

Text Generation • Updated 24 days ago • 32

neuralmagic/granite-3.1-8b-base-quantized.w4a16

Text Generation • Updated 24 days ago • 58

neuralmagic/granite-3.1-8b-base-FP8-dynamic

Text Generation • Updated 3 days ago • 7

async0x42/granite-3.1-8b-instruct-exl2_4.65bpw

Text Generation • Updated 30 days ago • 13

TheMelonGod/granite-3.1-8b-base-exl2

Text Generation • Updated 25 days ago • 198