Hugging Face's logo

ReadyArt
/
Nexesenex_Llama_3.x_70b_Hexagon_Purple_V3-EXL2

EXL2
Model card Files Community

Llama_3.x_70b_Hexagon_Purple_V3-EXL2

Released by Nexesenex

Quant(s) by FrenzyBiscuit

5.35 BPW H6 - Fits in 72GB VRAM with 64k FP16 context

6.70 BPW H6 - Fits in 72GB VRAM with 32k FP16 context

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/Nexesenex_Llama_3.x_70b_Hexagon_Purple_V3-EXL2

Base model

Nexesenex/Llama_3.x_70b_Hexagon_Purple_V3
Quantized
(10)
this model

Collection including ReadyArt/Nexesenex_Llama_3.x_70b_Hexagon_Purple_V3-EXL2