Daniel (Unsloth)'s picture

Daniel (Unsloth) PRO

danielhanchen

·

https://unsloth.ai/

AI & ML interests

None yet

Recent Activity

new activity 3 days ago

unsloth/Kimi-K2.5-GGUF:Can you make a REAP verson at 50

liked a dataset 3 days ago

uv-scripts/unsloth-jobs

replied to their post 3 days ago

You can now run Kimi K2.5 locally! 🔥 We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit. Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision. GGUF: https://huggingface.co/unsloth/Kimi-K2.5-GGUF Guide: https://unsloth.ai/docs/models/kimi-k2.5

View all activity

Organizations

New activity in unsloth/Kimi-K2.5-GGUF 3 days ago

Can you make a REAP verson at 50

#4 opened 4 days ago by

New activity in unsloth/DeepSeek-V3.2-GGUF 3 days ago

Does this support DSA/lighting attention?

#1 opened 4 days ago by

Already testing it

#2 opened 3 days ago by

New activity in unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF 3 days ago

New Refresh with added Tool Calling in calibration dataset and improved imatrix

#21 opened 4 days ago by

New activity in unsloth/Kimi-K2.5-GGUF 4 days ago

Q4_K_S versus Q3_K_XL

#3 opened 4 days ago by

New activity in unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF 4 days ago

Performance is poor

#1 opened 9 days ago by

New activity in unsloth/DeepSeek-OCR-2 4 days ago

Unsloth implementation

#1 opened 6 days ago by

New activity in unsloth/Trinity-Large-Preview-GGUF 5 days ago

Quantasation for Ming-flash-omni-Preview?

#1 opened 5 days ago by

facehuggerfromspace

New activity in unsloth/Kimi-K2.5-GGUF 5 days ago

Original model is just 600gb

#2 opened 5 days ago by

New activity in unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF 5 days ago

The generation falls into constant repetition without any good result

#2 opened 9 days ago by

Fix typos in README.md

#3 opened 8 days ago by

New activity in unsloth/GLM-4.7-Flash-FP8-Dynamic 5 days ago

vllm nightly currently not supporting Blackwell with this model

#3 opened 6 days ago by

dual 3090 inference

#1 opened 7 days ago by

New activity in unsloth/GLM-4.7-Flash-GGUF 6 days ago

New flag: kv-unified. Performance report: 90 t/s on RTX 4090D 48GB

#18 opened 6 days ago by

New activity in unsloth/GLM-4.7-Flash-FP8-Dynamic 6 days ago

Severe Looping/Repetitive Output when using --kv-cache-dtype fp8 with GLM-4.7-Flash-FP8-Dynamic on vLLM

#2 opened 6 days ago by

New activity in deepseek-ai/DeepSeek-OCR-2 6 days ago

Guide to Run + Fine-tune DeepSeek-OCR 2

#4 opened 6 days ago by

New activity in unsloth/GLM-4.7-Flash-GGUF 8 days ago

Fix GLM 4.7 Lite MoE gating func

#9 opened 12 days ago by

New activity in unsloth/ERNIE-4.5-21B-A3B-PT-GGUF 9 days ago

update the gguf

#4 opened 3 months ago by

New activity in unsloth/GLM-4.7-Flash-GGUF 10 days ago

DISABLE REPEAT PENALTY or set = 1.0

#13 opened 10 days ago by

new ggufs working as intended

#12 opened 10 days ago by