ERROR when load
#2
by
pbwpbw
- opened
[rank0]: File "/home/pubw/anaconda/envs/vllm/lib/python3.10/site-packages/vllm/model_executor/models/qwen2_5_vl.py", line 672, in load_weights
[rank0]: loaded_weight = loaded_weight.view(3, visual_num_heads,
[rank0]: File "/home/pubw/anaconda/envs/vllm/lib/python3.10/site-packages/torch/utils/_device.py", line 106, in torch_function
[rank0]: return func(*args, **kwargs)
[rank0]: RuntimeError: shape '[3, 16, 80, 1280]' is invalid for input of size 2457600
I use vLLM to deploy this model but hit this error
same too
我也遇到同样的问题，有什么解决的方法吗？