Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

32,317

Full-text search

Active filters: bitsandbytes

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 42.9k • 23

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.13k • 12

mac999/Llama3-8B-BIM

Text Generation • Updated Jul 11, 2024 • 15 • 1

PrunaAI/apple-OpenELM-270M-bnb-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 108 • 1

robinhad/UAlpaca-2.0-Mistral-7B

Text Generation • Updated Jul 14, 2024 • 90 • 1

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated 22 days ago • 9.71k • 15

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated 22 days ago • 19.4k • 27

Svngoku/kongostral

Text Generation • Updated Jul 23, 2024 • 87 • 3

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 4.07k • 34

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 9 days ago • 765k • 56

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 5.66k • 31

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 8.36k • 29

unsloth/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 260k • 16

PrunaAI/Aratako-Oumuamua-7b-RP-bnb-4bit-smashed

Text Generation • Updated Jul 24, 2024 • 88 • 1

unsloth/gemma-2-2b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 13.9k • 9

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 16.3k • 15

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Jan 15 • 137k • 74

unsloth/Qwen2-Math-1.5B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 66 • 1

unsloth/Qwen2-Math-7B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 64 • 1

unsloth/Qwen2-Math-7B-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 60 • 1

unsloth/Qwen2-Math-1.5B-Instruct-bnb-4bit

Text Generation • Updated Aug 8, 2024 • 72 • 1

Sergei6000/Qwen2-Audio-7B-Instruct-Int4

Updated Aug 10, 2024 • 118 • 5

PrunaAI/IlyaGusev-gemma-2-2b-it-abliterated-bnb-4bit-smashed

Updated Aug 14, 2024 • 16 • 1

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 9 • 2

PrunaAI/Writer-palmyra-base-bnb-4bit-smashed

Updated Aug 20, 2024 • 11 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 32.6k • 12

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24, 2024 • 367 • 43

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25, 2024 • 28 • 10

unsloth/c4ai-command-r-08-2024-bnb-4bit

Text Generation • Updated Dec 16, 2024 • 275 • 9

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1, 2024 • 61 • 16