-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
TheBloke/bagel-dpo-34b-v0.2-AWQ
Text Generation
•
5B
•
Updated
•
10
•
8
Qwen/Qwen1.5-4B-Chat-GPTQ-Int4
Text Generation
•
1B
•
Updated
•
93
•
6
zementalist/llama-3-8B-chat-psychotherapist
Text Generation
•
5B
•
Updated
•
41
•
29
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
•
7B
•
Updated
•
175k
•
108
unsloth/Qwen2-7B-Instruct-bnb-4bit
Text Generation
•
4B
•
Updated
•
3.84k
•
7
akashcsd/Llama3_project_management_assistant
Text Generation
•
Updated
•
18
•
3
wiweka24/gemma-psychiatrist-v0-4bit
Text Generation
•
5B
•
Updated
•
3
•
2
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Text Generation
•
3B
•
Updated
•
62
•
5
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation
•
5B
•
Updated
•
562k
•
81
pbevan11/llama-3.1-8b-ocr-correction
Updated
•
102
•
3
openbmb/MiniCPM-V-2_6-int4
Image-Text-to-Text
•
5B
•
Updated
•
27k
•
84
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
•
4B
•
Updated
•
197k
•
19
MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF
Text Generation
•
1B
•
Updated
•
155k
•
14
Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4
Text Generation
•
2B
•
Updated
•
36.1k
•
27
Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4
Text Generation
•
3B
•
Updated
•
9.15k
•
21
Qwen/Qwen2.5-32B-Instruct-AWQ
Text Generation
•
6B
•
Updated
•
61.7k
•
85
Qwen/Qwen2.5-Coder-7B-Instruct-AWQ
Text Generation
•
2B
•
Updated
•
102k
•
14
unsloth/Llama-3.2-3B-bnb-4bit
Text Generation
•
2B
•
Updated
•
13.9k
•
18
AMead10/Llama-3.2-1B-Instruct-AWQ
Text Generation
•
0.7B
•
Updated
•
1.15k
•
6
ToastyPigeon/mistral-small-adventure-qlora
Updated
•
6
•
1
mlx-community/TheDrummer_Big-Tiger-Gemma-27B-v1_4bit
4B
•
Updated
•
136
•
1
John6666/Llama-3.1-8B-Lexi-Uncensored-V2-nf4
Text Generation
•
5B
•
Updated
•
1.61k
•
21
Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int4
Text Generation
•
3B
•
Updated
•
2.81k
•
5
jkeyyy/smart-contract-auditing
Question Answering
•
5B
•
Updated
•
12
•
1
sandbox-ai/Llama-3.1-Tango-70b-bnb_4b
Text Generation
•
37B
•
Updated
•
702
•
3
OPEA/Llama-3.2V-11B-cot-int4-sym-inc
3B
•
Updated
•
19
•
1
QuixiAI/DeepSeek-R1-AWQ
Text Generation
•
Updated
•
1.65k
•
85
redcathode/fabricator
0.0B
•
Updated
•
208
•
2
mlx-community/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q4-mlx
Text Generation
•
2B
•
Updated
•
31
•
2
unsloth/Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text
•
3B
•
Updated
•
13.6k
•
14