8.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2

8bit heads. Default measurement dataset.

Downloads last month
13
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for MarsupialAI/EVA-Qwen2.5-14B-v0.2_EXL2_8.0BPW_H8

Base model

Qwen/Qwen2.5-14B
Quantized
(79)
this model