This is the 8bit BitsAndBytes quantized version of the https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct

Downloads last month
1
Safetensors
Model size
73.4B params
Tensor type
F32
·
BF16
·
I8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Maverick17/Qwen2.5-VL-72B-Instruct-bnb-8bit

Quantized
(32)
this model