| 2025-08-21 00:33:08 - INFO - Loading model: Qwen/Qwen2.5-VL-3B-Instruct-AWQ | |
| 2025-08-21 00:33:56 - INFO - We will use 90% of the memory on device 0 for storing the model, and 10% for the buffer to avoid OOM. You can set `max_memory` in to a higher value to use more memory (at your own risk). | |