exllamav3 quantizations of ArliAI's DS-R1-Distill-70B-ArliAI-RpR-v4-Large
2.25bpw h6 (20.661 GiB)
4.25bpw h6 (36.598 GiB)
Model tree for MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl3
Base model
deepseek-ai/DeepSeek-R1-Distill-Llama-70Bexllamav3 quantizations of ArliAI's DS-R1-Distill-70B-ArliAI-RpR-v4-Large
2.25bpw h6 (20.661 GiB)
4.25bpw h6 (36.598 GiB)
Base model
deepseek-ai/DeepSeek-R1-Distill-Llama-70B