How do you run this model?
#1
by
for1096
- opened
I updated transformers library with current github master.
Then run vllm serve Benasd/Qwen2.5-VL-72B-Instruct-AWQ
results in errors like
ERROR 02-15 14:12:57 registry.py:306] from transformers.models.qwen2_5_vl import (Qwen2_5_VLImageProcessor,
ERROR 02-15 14:12:57 registry.py:306] ImportError: cannot import name 'Qwen2_5_VLImageProcessor' from 'transformers.models.qwen2_5_vl' (/home/*/anaconda3/envs/vllm/lib/python3.12/site-packages/transformers/models/qwen2_5_vl/__init__.py). Did you mean: 'Qwen2_5_VLProcessor'?
Run pip install -U git+https://github.com/huggingface/transformers.git to update transformers.
Make sure to use -U flag.