| 2025-08-20 21:59:36 - INFO - Loading model: LiquidAI/LFM2-VL-1.6B | |
| 2025-08-20 21:59:37 - INFO - We will use 90% of the memory on device 0 for storing the model, and 10% for the buffer to avoid OOM. You can set `max_memory` in to a higher value to use more memory (at your own risk). | |
| 2025-08-20 22:00:07 - INFO - Model loaded in 31.10 seconds | |
| 2025-08-20 22:00:07 - INFO - GPU Memory Usage after model load: 3023.64 MB | |
| 2025-08-20 22:07:37 - INFO - [5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0] Received new video inference request. Prompt: '视频里发生了什么？', Video: 'sample_part_001.mp4' | |
| 2025-08-20 22:07:37 - INFO - [5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0] Video saved to temporary file: temp_videos/5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0.mp4 | |
| 2025-08-20 22:07:37 - INFO - [5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:07:43 - INFO - [5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:07:43 - INFO - [5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0] 30 frames saved to temp_videos/5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0 | |
| 2025-08-20 22:07:44 - INFO - Prompt token length: 3585 | |
| 2025-08-20 22:08:04 - INFO - Tokens per second: 40.26488449689874, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:08:04 - INFO - [5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0] Inference time: 27.25 seconds, CPU usage: 31.0%, CPU core utilization: [30.5, 30.3, 31.0, 32.3] | |
| 2025-08-20 22:08:04 - INFO - [5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0] Cleaned up temporary file: temp_videos/5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0.mp4 | |
| 2025-08-20 22:08:04 - INFO - [5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0] Cleaned up temporary frame directory: temp_videos/5d6ff8cd-5dd3-4c3f-bb14-6bb5a2d49aa0 | |
| 2025-08-20 22:08:04 - INFO - [7d334c4a-5ec5-47d1-9af6-5134d7017e7c] Received new video inference request. Prompt: '视频里发生了什么？', Video: 'sample_part_001.mp4' | |
| 2025-08-20 22:08:04 - INFO - [7d334c4a-5ec5-47d1-9af6-5134d7017e7c] Video saved to temporary file: temp_videos/7d334c4a-5ec5-47d1-9af6-5134d7017e7c.mp4 | |
| 2025-08-20 22:08:04 - INFO - [7d334c4a-5ec5-47d1-9af6-5134d7017e7c] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:08:12 - INFO - [7d334c4a-5ec5-47d1-9af6-5134d7017e7c] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:08:12 - INFO - [7d334c4a-5ec5-47d1-9af6-5134d7017e7c] 30 frames saved to temp_videos/7d334c4a-5ec5-47d1-9af6-5134d7017e7c | |
| 2025-08-20 22:08:13 - INFO - Prompt token length: 3585 | |
| 2025-08-20 22:08:32 - INFO - Tokens per second: 41.8782758123788, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:08:32 - INFO - [7d334c4a-5ec5-47d1-9af6-5134d7017e7c] Inference time: 27.77 seconds, CPU usage: 76.0%, CPU core utilization: [65.2, 79.8, 85.9, 73.3] | |
| 2025-08-20 22:08:32 - INFO - [7d334c4a-5ec5-47d1-9af6-5134d7017e7c] Cleaned up temporary file: temp_videos/7d334c4a-5ec5-47d1-9af6-5134d7017e7c.mp4 | |
| 2025-08-20 22:08:32 - INFO - [7d334c4a-5ec5-47d1-9af6-5134d7017e7c] Cleaned up temporary frame directory: temp_videos/7d334c4a-5ec5-47d1-9af6-5134d7017e7c | |
| 2025-08-20 22:08:32 - INFO - [47246552-af71-4d3c-b034-bc4f74bcfaee] Received new video inference request. Prompt: '视频里发生了什么？', Video: 'sample_part_002.mp4' | |
| 2025-08-20 22:08:32 - INFO - [47246552-af71-4d3c-b034-bc4f74bcfaee] Video saved to temporary file: temp_videos/47246552-af71-4d3c-b034-bc4f74bcfaee.mp4 | |
| 2025-08-20 22:08:32 - INFO - [47246552-af71-4d3c-b034-bc4f74bcfaee] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:08:41 - INFO - [47246552-af71-4d3c-b034-bc4f74bcfaee] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:08:41 - INFO - [47246552-af71-4d3c-b034-bc4f74bcfaee] 30 frames saved to temp_videos/47246552-af71-4d3c-b034-bc4f74bcfaee | |
| 2025-08-20 22:08:41 - INFO - Prompt token length: 3585 | |
| 2025-08-20 22:08:58 - INFO - Tokens per second: 37.12922143875923, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:08:58 - INFO - [47246552-af71-4d3c-b034-bc4f74bcfaee] Inference time: 26.39 seconds, CPU usage: 78.7%, CPU core utilization: [77.4, 73.7, 79.6, 83.9] | |
| 2025-08-20 22:08:58 - INFO - [47246552-af71-4d3c-b034-bc4f74bcfaee] Cleaned up temporary file: temp_videos/47246552-af71-4d3c-b034-bc4f74bcfaee.mp4 | |
| 2025-08-20 22:08:58 - INFO - [47246552-af71-4d3c-b034-bc4f74bcfaee] Cleaned up temporary frame directory: temp_videos/47246552-af71-4d3c-b034-bc4f74bcfaee | |
| 2025-08-20 22:08:59 - INFO - [cc126bf6-5c43-48b6-aa29-d38a216bc50a] Received new video inference request. Prompt: '视频里发生了什么？', Video: 'sample_part_002.mp4' | |
| 2025-08-20 22:08:59 - INFO - [cc126bf6-5c43-48b6-aa29-d38a216bc50a] Video saved to temporary file: temp_videos/cc126bf6-5c43-48b6-aa29-d38a216bc50a.mp4 | |
| 2025-08-20 22:08:59 - INFO - [cc126bf6-5c43-48b6-aa29-d38a216bc50a] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:09:05 - INFO - [cc126bf6-5c43-48b6-aa29-d38a216bc50a] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:09:05 - INFO - [cc126bf6-5c43-48b6-aa29-d38a216bc50a] 30 frames saved to temp_videos/cc126bf6-5c43-48b6-aa29-d38a216bc50a | |
| 2025-08-20 22:09:06 - INFO - Prompt token length: 3585 | |
| 2025-08-20 22:09:23 - INFO - Tokens per second: 42.08466552693894, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:09:23 - INFO - [cc126bf6-5c43-48b6-aa29-d38a216bc50a] Inference time: 24.01 seconds, CPU usage: 79.0%, CPU core utilization: [77.0, 80.9, 81.3, 76.9] | |
| 2025-08-20 22:09:23 - INFO - [cc126bf6-5c43-48b6-aa29-d38a216bc50a] Cleaned up temporary file: temp_videos/cc126bf6-5c43-48b6-aa29-d38a216bc50a.mp4 | |
| 2025-08-20 22:09:23 - INFO - [cc126bf6-5c43-48b6-aa29-d38a216bc50a] Cleaned up temporary frame directory: temp_videos/cc126bf6-5c43-48b6-aa29-d38a216bc50a | |