ISTA-DASLab
/

Qwen2-72B-Instruct-AQLM-PV-1bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

No model card

Downloads last month: 137

Safetensors

Model size

7.48B params

Tensor type

FP16

·

I16

·

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

Collection including ISTA-DASLab/Qwen2-72B-Instruct-AQLM-PV-1bit-1x16

AQLM+PV

Official AQLM quantizations for "PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression": https://arxiv.org/abs/2405.14852 • 25 items • Updated Dec 18, 2024 • 20