MikeRoz
/

QwQ-32B-ArliAI-RpR-v4-exl3

Text Generation

Model card Files Files and versions Community

exllamav3 quantizations of ArliAI's QwQ-32B-ArliAI-RpR-v4.

2.25bpw h6 (10.201 GiB)
3.00bpw h6 (12.925 GiB)
4.00bpw h6 (16.558 GiB)
6.00bpw h6 (23.824 GiB)
8.00bpw h8 (31.271 GiB)

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for MikeRoz/QwQ-32B-ArliAI-RpR-v4-exl3

Base model

Qwen/Qwen2.5-32B

Finetuned

Finetuned

ArliAI/QwQ-32B-ArliAI-RpR-v4

Quantized

(22)

this model