Could we try quantizing it to fp8?
#1
by
win10
- opened
@danielhanchen
Could we try quantizing it to fp8?
https://huggingface.co/huihui-ai/Huihui-Qwen3-Coder-Next-abliterated
@danielhanchen
Could we try quantizing it to fp8?
https://huggingface.co/huihui-ai/Huihui-Qwen3-Coder-Next-abliterated
Totally Free + Zero Barriers + No Login Required