Hugging Face's logo

ReadyArt
/
EVA-UNIT-01_EVA-Qwen2.5-72B-v0.2-EXL2

EXL2
Model card Files
xet
Community

EVA-Qwen2.5-72B-v0.2-EXL2

Released by EVA-UNIT-01

Quant(s) by FrenzyBiscuit

4.35 BPW H6 - Fits in 48GB VRAM with 24k FP16 context

5.10 BPW H6 - Fits in 72GB VRAM with 64k FP16 context

6.75 BPW H6 - Fits in 72GB VRAM with 32k FP16 context

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/EVA-UNIT-01_EVA-Qwen2.5-72B-v0.2-EXL2

Base model

Qwen/Qwen2.5-72B
Finetuned
EVA-UNIT-01/EVA-Qwen2.5-72B-v0.2
Quantized
(10)
this model

Collection including ReadyArt/EVA-UNIT-01_EVA-Qwen2.5-72B-v0.2-EXL2