169 19 208

Michael Han

shimmyshimmer

https://unsloth.ai

AI & ML interests

None yet

Recent Activity

updated a model 1 day ago

unsloth/r1-1776-distill-llama-70b-GGUF

updated a model 1 day ago

unsloth/r1-1776-distill-llama-70b-unsloth-bnb-4bit

updated a model 1 day ago

unsloth/r1-1776-distill-llama-70b-bnb-4bit

View all activity

Organizations

shimmyshimmer's activity

New activity in unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit 3 days ago

Is it possible to add this or any other Dynamic Quants model to ollama?

#2 opened 4 days ago by

Crandel

New activity in unsloth/Qwen2.5-VL-72B-Instruct-bnb-4bit 3 days ago

Update preprocessor_config.json

#3 opened 5 days ago by

TahirC

New activity in unsloth/DeepSeek-R1-GGUF 5 days ago

is it uncensored?

#33 opened 6 days ago by

Morrigan-Ship

New activity in unsloth/Qwen2.5-32B-bnb-4bit 7 days ago

Dynamic quantization

#1 opened 8 days ago by

woctordho

New activity in unsloth/README 10 days ago

I can't run any of the bnb-4bit quants with TextGenerationInference

#6 opened 13 days ago by

v3ss0n

New activity in unsloth/DeepSeek-R1-GGUF 10 days ago

8bits quantization

#20 opened 17 days ago by

ramkumarkoppu

New activity in unsloth/DeepSeek-V3-GGUF 10 days ago

Is it worth hosting a quantized DeepSeek V3? Cost & performance insights?

#15 opened 15 days ago by

Techw

New activity in unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF 10 days ago

hey how about refine-tuning the model

#7 opened 14 days ago by

OqbaN

New activity in unsloth/phi-4 10 days ago

About the phi-4 training Hyperparameters

#1 opened 15 days ago by

zj2023vegetable

New activity in unsloth/DeepSeek-R1-GGUF 10 days ago

I tested dynamic 1.58bit and 2.22bit, All thoughts are empty?

#24 opened 13 days ago by

SongXiaoMao

IQ1_S模型合并后部署于ollama上，推理生成效果差

#26 opened 12 days ago by

gaozj

when using with ollama, does it support kv_cache_type=q4_0 and flash_attention=1?

#28 opened 12 days ago by

leonzy04

New activity in unsloth/llava-1.5-7b-hf-bnb-4bit 10 days ago

Update processor_config.json

#1 opened 12 days ago by

RaushanTurganbay

New activity in unsloth/llava-v1.6-mistral-7b-hf-bnb-4bit 10 days ago

Update processor_config.json

#1 opened 12 days ago by

baraujo22

New activity in unsloth/Llama-3.2-11B-Vision-unsloth-bnb-4bit 10 days ago

Saving to q5_k_m GGUF

#1 opened 11 days ago by

sasha1234567

New activity in unsloth/DeepSeek-R1-GGUF 10 days ago

各种量化版本的模型，在不同测评数据集上面的表现怎么样，有没有具体的测试结果

#29 opened 10 days ago by

huanfa

New activity in unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit 10 days ago

Llama 3.2 vision 11B model for OCR task

#1 opened about 1 month ago by

Pavankumar03

New activity in unsloth/DeepSeek-R1-GGUF 10 days ago

Running this model using vLLM Docker

#8 opened 26 days ago by

moficodes

Accuracy of the dynamic quants compared to usual quants?

#21 opened 16 days ago by

inputout

Support Vllm?

#30 opened 10 days ago by

caoyizhen