ArtusDev
/

ArliAI_DS-R1-Distill-70B-ArliAI-RpR-v4-Large-EXL3

Text Generation

Model card Files Files and versions

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

EXL3 Quants of ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large

EXL3 quants of ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large using exllamav3 for quantization.

Quants

Quant(Revision)	Bits per Weight	Head Bits
2.5_H6	2.5	6
3.0_H6	3.0	6
3.5_H6	3.5	6
4.0_H6	4.0	6
4.25_H6	4.25	6
5.0_H6	5.0	6
6.0_H6	6.0	6
8.0_H8	8.0	8

Downloading quants with huggingface-cli

Click to view download instructions

Install hugginface-cli:

pip install -U "huggingface_hub[cli]"

Download quant by targeting the specific quant revision (branch):

huggingface-cli download ArtusDev/ArliAI_DS-R1-Distill-70B-ArliAI-RpR-v4-Large-EXL3 --revision "5.0bpw_H6" --local-dir ./

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for ArtusDev/ArliAI_DS-R1-Distill-70B-ArliAI-RpR-v4-Large-EXL3

Base model

deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Finetuned

ArliAI/DS-R1-Distill-70B-ArliAI-RpR-v4-Large

Quantized

(7)

this model