-
warshanks/Qwen3-30B-A3B-Instruct-2507-AWQ
Text Generation • 5B • Updated • 103 -
warshanks/Qwen3-16B-A3B-abliterated-AWQ
Text Generation • 3B • Updated • 119 • 1 -
warshanks/Huihui-Qwen3-14B-abliterated-v2-AWQ
Text Generation • 3B • Updated • 221 • 2 -
warshanks/Qwen3-8B-abliterated-AWQ
Text Generation • 2B • Updated • 227
Ben Shankles PRO
warshanks
AI & ML interests
MLX, AWQ, GPTQ / AI in Healthcare
Recent Activity
new activity
8 days ago
unsloth/GLM-4.6V-Flash-GGUF:Update with vision support
published
a Space
about 1 month ago
warshanks/FLUX.2-dev
new activity
2 months ago
inclusionAI/Ring-mini-2.0-GGUF:Official llama.cpp support merged
Organizations
W4A16 quants made with llmcompressor
MedGemma MLX conversions I've done
DeepSeek MLX conversions I've done
-
mlx-community/DeepSeek-R1-0528-Qwen3-8B-4bit
Text Generation • 1B • Updated • 784 • 4 -
mlx-community/DeepSeek-R1-0528-Qwen3-8B-6bit
Text Generation • 8B • Updated • 32 • 1 -
mlx-community/DeepSeek-R1-0528-Qwen3-8B-8bit
Text Generation • 2B • Updated • 88 • 1 -
mlx-community/DeepSeek-R1-0528-Qwen3-8B-bf16
Text Generation • 8B • Updated • 97 • • 3
Nemotron MLX conversions I've done
Abliterated model conversions to MLX
-
mlx-community/Josiefied-Health-Qwen3-8B-abliterated-v1-4bit
Text Generation • 1B • Updated • 21 -
mlx-community/Josiefied-Health-Qwen3-8B-abliterated-v1-8bit
Text Generation • 8B • Updated • 15 -
mlx-community/Josiefied-Health-Qwen3-8B-abliterated-v1-bf16
Text Generation • 8B • Updated • 17 • 1 -
mlx-community/Josiefied-DeepSeek-R1-0528-Qwen3-8B-abliterated-v1-4bit
Text Generation • 1B • Updated • 161 • 2
Menlo Research Quantizations
Mistral Quantizations
Lingshu MLX conversions
-
Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning
Paper • 2506.07044 • Published • 113 -
mlx-community/Lingshu-7B-4bit
Image-Text-to-Text • 1B • Updated • 12 -
mlx-community/Lingshu-7B-6bit
Image-Text-to-Text • Updated • 16 -
mlx-community/Lingshu-7B-8bit
Image-Text-to-Text • Updated • 16
Healthcare oriented LLM conversions to MLX
TheDrummer MLX model conversions I've done
-
warshanks/Qwen3-30B-A3B-Instruct-2507-AWQ
Text Generation • 5B • Updated • 103 -
warshanks/Qwen3-16B-A3B-abliterated-AWQ
Text Generation • 3B • Updated • 119 • 1 -
warshanks/Huihui-Qwen3-14B-abliterated-v2-AWQ
Text Generation • 3B • Updated • 221 • 2 -
warshanks/Qwen3-8B-abliterated-AWQ
Text Generation • 2B • Updated • 227
Menlo Research Quantizations
W4A16 quants made with llmcompressor
Mistral Quantizations
MedGemma MLX conversions I've done
Lingshu MLX conversions
-
Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning
Paper • 2506.07044 • Published • 113 -
mlx-community/Lingshu-7B-4bit
Image-Text-to-Text • 1B • Updated • 12 -
mlx-community/Lingshu-7B-6bit
Image-Text-to-Text • Updated • 16 -
mlx-community/Lingshu-7B-8bit
Image-Text-to-Text • Updated • 16
DeepSeek MLX conversions I've done
-
mlx-community/DeepSeek-R1-0528-Qwen3-8B-4bit
Text Generation • 1B • Updated • 784 • 4 -
mlx-community/DeepSeek-R1-0528-Qwen3-8B-6bit
Text Generation • 8B • Updated • 32 • 1 -
mlx-community/DeepSeek-R1-0528-Qwen3-8B-8bit
Text Generation • 2B • Updated • 88 • 1 -
mlx-community/DeepSeek-R1-0528-Qwen3-8B-bf16
Text Generation • 8B • Updated • 97 • • 3
Healthcare oriented LLM conversions to MLX
Nemotron MLX conversions I've done
TheDrummer MLX model conversions I've done
Abliterated model conversions to MLX
-
mlx-community/Josiefied-Health-Qwen3-8B-abliterated-v1-4bit
Text Generation • 1B • Updated • 21 -
mlx-community/Josiefied-Health-Qwen3-8B-abliterated-v1-8bit
Text Generation • 8B • Updated • 15 -
mlx-community/Josiefied-Health-Qwen3-8B-abliterated-v1-bf16
Text Generation • 8B • Updated • 17 • 1 -
mlx-community/Josiefied-DeepSeek-R1-0528-Qwen3-8B-abliterated-v1-4bit
Text Generation • 1B • Updated • 161 • 2