Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,319

Full-text search

Active filters: 8-bit

Mediocreatmybest/blip2-opt-2.7b_8bit

Image-to-Text • Updated Aug 27, 2023 • 289 • 2

Mediocreatmybest/blip2-opt-6.7b_8bit

Image-to-Text • Updated Aug 27, 2023 • 26 • 1

Mediocreatmybest/blip2-flan-t5-xxl_8bit

Visual Question Answering • Updated Jul 9, 2023 • 6

gretelai/falcon-7b

Text Generation • Updated Jul 10, 2023 • 16

sgowdaks/falcon-40b-instruct-8bit

Updated Jul 11, 2023 • 5

FabbriSimo01/GPT_Large_Quantized

Text Generation • Updated Jul 15, 2023 • 1.93k

FabbriSimo01/Bloom_1b_Quantized

Text Generation • Updated Jul 15, 2023 • 1.94k

FabbriSimo01/Facebook_opt_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 1.94k

FabbriSimo01/Cerebras_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 1.93k

vivekraina/Falcon-8bit-test

Text Generation • Updated Jul 19, 2023 • 14

trillionmonster/Baichuan-13B-Chat-8bit

Text Generation • Updated Jul 25, 2023 • 24 • 9

vivekraina/Llama-2-7b-hf-8bit

Text Generation • Updated Jul 20, 2023 • 5 • 3

guardrail/llama-2-7b-guanaco-8bit-sharded

Text Generation • Updated Jul 20, 2023 • 9 • 4

richardr1126/spider-skeleton-wizard-coder-8bit

Text Generation • Updated Jul 26, 2023 • 10 • 1

rbiswasfc/falcon-7b-8bit

Text Generation • Updated Jul 21, 2023 • 4

pligor/gr7.5b-dolly

Text Generation • Updated Jul 24, 2023 • 5 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • Updated Nov 19, 2023 • 23 • 3

osiria/primo

Text Generation • Updated Aug 12, 2023 • 28 • 2

vivym/chatglm2-6b-int4

Text2Text Generation • Updated Jul 27, 2023 • 7

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 6

Matsakitkat/Mobility_Future_expectation

Text Generation • Updated Aug 1, 2023 • 81

anhtunguyen98/flan-t5-xxl-8bit

Text2Text Generation • Updated Jul 28, 2023 • 6

vivekraina/Llama-2-13b-chat-hf-8bit

Text Generation • Updated Jul 28, 2023 • 6

Mediocreatmybest/instructblip-vicuna-13b_8bit

Image-Text-to-Text • Updated Nov 19, 2023 • 10

TransformerTales/llama-2-7b-8bit-nested

Text Generation • Updated Aug 5, 2023 • 5 • 2

legendhasit/xgen-7b-8k-open-instruct-8bit

Text Generation • Updated Jul 31, 2023 • 74

Harshvir/LaMini-Neo-1.3B-Mental-Health_lora

Text Generation • Updated Jul 31, 2023 • 1.92k • 2

manojkumarvohra/llama2-7B-8bit-guanaco-pico-finetuned

Text Generation • Updated Aug 1, 2023 • 77

valhalla/muse-laiona5-oai-clip-384res-8bit

Updated Aug 1, 2023 • 72

snigdhachandan/gtr_large_8bit

Feature Extraction • Updated Aug 3, 2023 • 5