|
2025-08-20 23:23:16 - INFO - Loading model: LiquidAI/LFM2-VL-1.6B |
|
2025-08-20 23:23:18 - INFO - We will use 90% of the memory on device 0 for storing the model, and 10% for the buffer to avoid OOM. You can set `max_memory` in to a higher value to use more memory (at your own risk). |
|
2025-08-20 23:23:24 - INFO - Model loaded in 7.69 seconds |
|
2025-08-20 23:23:24 - INFO - GPU Memory Usage after model load: 3023.64 MB |
|
2025-08-20 23:23:36 - INFO - [dbbd5e6a-91d4-4c60-91ae-6b6d212302e1] Received new video inference request. Prompt: 'Please describe the video in detail, only focus on customer and staff behavior and activities and do not overly describe the static scene.', Video: 'sample_part_001.mp4' |
|
2025-08-20 23:23:36 - INFO - [dbbd5e6a-91d4-4c60-91ae-6b6d212302e1] Video saved to temporary file: temp_videos/dbbd5e6a-91d4-4c60-91ae-6b6d212302e1.mp4 |
|
2025-08-20 23:23:36 - INFO - [dbbd5e6a-91d4-4c60-91ae-6b6d212302e1] Extracting frames using method: uniform, rate/threshold: 30 |
|
2025-08-20 23:23:44 - INFO - [dbbd5e6a-91d4-4c60-91ae-6b6d212302e1] Extracted 30 frames successfully. Saving to temporary files... |
|
2025-08-20 23:23:44 - INFO - [dbbd5e6a-91d4-4c60-91ae-6b6d212302e1] 30 frames saved to temp_videos/dbbd5e6a-91d4-4c60-91ae-6b6d212302e1 |
|
2025-08-20 23:23:44 - INFO - Prompt token length: 3604 |
|
2025-08-20 23:24:04 - INFO - Tokens per second: 42.609188518901775, Peak GPU memory MB: 9378.375 |
|
2025-08-20 23:24:04 - INFO - [dbbd5e6a-91d4-4c60-91ae-6b6d212302e1] Inference time: 28.08 seconds, CPU usage: 61.6%, CPU core utilization: [56.9, 67.6, 54.1, 67.9] |
|
2025-08-20 23:24:04 - INFO - [dbbd5e6a-91d4-4c60-91ae-6b6d212302e1] Cleaned up temporary file: temp_videos/dbbd5e6a-91d4-4c60-91ae-6b6d212302e1.mp4 |
|
2025-08-20 23:24:04 - INFO - [dbbd5e6a-91d4-4c60-91ae-6b6d212302e1] Cleaned up temporary frame directory: temp_videos/dbbd5e6a-91d4-4c60-91ae-6b6d212302e1 |
|
2025-08-20 23:24:04 - INFO - [2750fe67-230a-46a2-87b9-928b60a2a3d4] Received new video inference request. Prompt: 'Please describe the video in detail, only focus on customer and staff behavior and activities and do not overly describe the static scene.', Video: 'sample_part_002.mp4' |
|
2025-08-20 23:24:04 - INFO - [2750fe67-230a-46a2-87b9-928b60a2a3d4] Video saved to temporary file: temp_videos/2750fe67-230a-46a2-87b9-928b60a2a3d4.mp4 |
|
2025-08-20 23:24:04 - INFO - [2750fe67-230a-46a2-87b9-928b60a2a3d4] Extracting frames using method: uniform, rate/threshold: 30 |
|
2025-08-20 23:24:09 - INFO - [2750fe67-230a-46a2-87b9-928b60a2a3d4] Extracted 30 frames successfully. Saving to temporary files... |
|
2025-08-20 23:24:09 - INFO - [2750fe67-230a-46a2-87b9-928b60a2a3d4] 30 frames saved to temp_videos/2750fe67-230a-46a2-87b9-928b60a2a3d4 |
|
2025-08-20 23:24:10 - INFO - Prompt token length: 3604 |
|
2025-08-20 23:24:32 - INFO - Tokens per second: 38.75598021320056, Peak GPU memory MB: 9378.375 |
|
2025-08-20 23:24:32 - INFO - [2750fe67-230a-46a2-87b9-928b60a2a3d4] Inference time: 27.76 seconds, CPU usage: 76.2%, CPU core utilization: [78.9, 78.2, 72.8, 75.0] |
|
2025-08-20 23:24:32 - INFO - [2750fe67-230a-46a2-87b9-928b60a2a3d4] Cleaned up temporary file: temp_videos/2750fe67-230a-46a2-87b9-928b60a2a3d4.mp4 |
|
2025-08-20 23:24:32 - INFO - [2750fe67-230a-46a2-87b9-928b60a2a3d4] Cleaned up temporary frame directory: temp_videos/2750fe67-230a-46a2-87b9-928b60a2a3d4 |
|
|