Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

32,287

Full-text search

Active filters: bitsandbytes

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 8 days ago • 217k • 98

prithivMLmods/Blaze.1-7B-Vision

Image-Text-to-Text • Updated Jan 15 • 288 • 7

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • Updated 9 days ago • 53.9k • 22

unsloth/DeepSeek-R1-Distill-Llama-70B-unsloth-bnb-4bit

Text Generation • Updated 9 days ago • 3.35k • 6

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 19.1k • 17

unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 3.09k • 6

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 111k • 196

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 135k • 21

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated Jan 7 • 108k • 35

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 85.3k • 41

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • Updated 9 days ago • 62.6k • 9

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • Updated 9 days ago • 222k • 19

unsloth/DeepSeek-R1-Distill-Qwen-32B-unsloth-bnb-4bit

Text Generation • Updated 9 days ago • 3.47k • 9

unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

Text Generation • Updated 21 days ago • 18.3k • 12

unsloth/Qwen2.5-VL-72B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 5.69k • 8

unsloth/r1-1776-distill-llama-70b-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 23 • 2

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 247 • 26

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 10k • 10

KnutJaegersberg/nllb-moe-54b-4bit

Translation • Updated Dec 16, 2023 • 21 • 5

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 18.8k • 25

unsloth/codellama-34b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 567 • 4

unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 891 • 5

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 7.95k • 5

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.93k • 11

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 549 • 2

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 13.8k • 32

unsloth/mistral-7b-instruct-v0.1-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 1.43k • 4

AISimplyExplained/Vakil-7B

Text Generation • Updated Jan 23, 2024 • 2.05k • 3

alnrg2arg/blockchainlabs_7B_merged_test2_4_prune_sft_4bit_DPO_orca

Text Generation • Updated Jan 26, 2024 • 16 • 2

unsloth/llama-2-7b-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 7.54k • 3