| 2025-08-18 22:18:04 - INFO - Loading model: Qwen/Qwen2-VL-2B-Instruct-AWQ | |
| 2025-08-18 22:18:07 - INFO - We will use 90% of the memory on device 0 for storing the model, and 10% for the buffer to avoid OOM. You can set `max_memory` in to a higher value to use more memory (at your own risk). | |
| 2025-08-18 22:18:15 - INFO - Model loaded in 10.56 seconds | |
| 2025-08-18 22:18:15 - INFO - GPU Memory Usage after model load: 2.31 GB | |
| 2025-08-18 22:18:24 - INFO - [f7d858d3-2aa9-419b-8876-9fa6c707b362] Received new video inference request. Prompt: 'Please describe the video.', Video: 'messi_part_001.mp4' | |
| 2025-08-18 22:18:24 - INFO - [f7d858d3-2aa9-419b-8876-9fa6c707b362] Video saved to temporary file: temp_videos/f7d858d3-2aa9-419b-8876-9fa6c707b362.mp4 | |
| 2025-08-18 22:18:24 - INFO - [f7d858d3-2aa9-419b-8876-9fa6c707b362] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-18 22:18:28 - INFO - [f7d858d3-2aa9-419b-8876-9fa6c707b362] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-18 22:18:28 - INFO - [f7d858d3-2aa9-419b-8876-9fa6c707b362] 30 frames saved to temp_videos/f7d858d3-2aa9-419b-8876-9fa6c707b362 | |
| 2025-08-18 22:18:29 - INFO - Prompt token length: 2276 | |
| 2025-08-18 22:18:39 - INFO - Tokens per second: 9.237412977708425, Avg GPU memory MB: 3164.08056640625 | |
| 2025-08-18 22:18:39 - ERROR - [f7d858d3-2aa9-419b-8876-9fa6c707b362] An error occurred during processing: [Errno 2] No such file or directory: 'outputs/Qwen2-VL-2B-Instruct-AWQ/20250818_221804.json' | |
| Traceback (most recent call last): | |
| File "/mnt/data/xiuying/Code/local_deploy/infer.py", line 110, in video_inference | |
| with open(os.path.join(OUTPUT_DIR, f"{start_time}.json"), "w") as f: | |
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
| FileNotFoundError: [Errno 2] No such file or directory: 'outputs/Qwen2-VL-2B-Instruct-AWQ/20250818_221804.json' | |
| 2025-08-18 22:18:39 - INFO - [f7d858d3-2aa9-419b-8876-9fa6c707b362] Cleaned up temporary file: temp_videos/f7d858d3-2aa9-419b-8876-9fa6c707b362.mp4 | |
| 2025-08-18 22:18:39 - INFO - [f7d858d3-2aa9-419b-8876-9fa6c707b362] Cleaned up temporary frame directory: temp_videos/f7d858d3-2aa9-419b-8876-9fa6c707b362 | |