Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

32,299

Full-text search

Active filters: bitsandbytes

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.99k • 3

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 111 • 2

unsloth/yi-34b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 81 • 3

unsloth/yi-34b-chat-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 114 • 2

unsloth/tinyllama-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 41.7k • 4

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 2.42k • 30

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.99k • 18

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.58k • 16

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 8.44k • 14

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 200 • 6

zamal/gemma-7b-finetuned

Text Generation • Updated Jun 11, 2024 • 390 • 5

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Sep 27, 2024 • 7.44k • 174

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 3.46k • 14

Sahi19/Gemma2bLegalChatbot

Text Generation • Updated Mar 25, 2024 • 1

Anant58/Genshin-chat-ARM

Text Generation • Updated Dec 13, 2024 • 90 • 1

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 193 • 1

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27, 2024 • 1.01k • 251

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 182 • 1

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 205 • 1

unsloth/gemma-1.1-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.26k • 5

unsloth/gemma-1.1-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 106 • 3

unsloth/Hermes-2-Pro-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 2.29k • 1

unsloth/OpenHermes-2.5-Mistral-7B-bnb-4bit

Text Generation • Updated Apr 7, 2024 • 4.15k • 3

unsloth/codegemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.51k • 1

unsloth/codegemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.88k • 3

unsloth/codegemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.23k • 1

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 50.6k • 131

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 1.17k • 46

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • Updated Apr 21, 2024 • 14 • 1

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 221 • 21