| 2025-08-20 22:09:50 - INFO - Loading model: LiquidAI/LFM2-VL-1.6B | |
| 2025-08-20 22:09:52 - INFO - We will use 90% of the memory on device 0 for storing the model, and 10% for the buffer to avoid OOM. You can set `max_memory` in to a higher value to use more memory (at your own risk). | |
| 2025-08-20 22:09:58 - INFO - Model loaded in 7.53 seconds | |
| 2025-08-20 22:09:58 - INFO - GPU Memory Usage after model load: 3023.64 MB | |
| 2025-08-20 22:10:07 - INFO - [afa49686-78ae-46eb-b2a4-8f75a70553bd] Received new video inference request. Prompt: 'Please describe the video in detail, only focus on customer and staff behavior and activities and do not overly describe the static scene.', Video: 'sample_part_001.mp4' | |
| 2025-08-20 22:10:07 - INFO - [afa49686-78ae-46eb-b2a4-8f75a70553bd] Video saved to temporary file: temp_videos/afa49686-78ae-46eb-b2a4-8f75a70553bd.mp4 | |
| 2025-08-20 22:10:07 - INFO - [afa49686-78ae-46eb-b2a4-8f75a70553bd] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:10:15 - INFO - [afa49686-78ae-46eb-b2a4-8f75a70553bd] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:10:15 - INFO - [afa49686-78ae-46eb-b2a4-8f75a70553bd] 30 frames saved to temp_videos/afa49686-78ae-46eb-b2a4-8f75a70553bd | |
| 2025-08-20 22:10:15 - INFO - Prompt token length: 3604 | |
| 2025-08-20 22:10:35 - INFO - Tokens per second: 41.32216588841384, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:10:35 - INFO - [afa49686-78ae-46eb-b2a4-8f75a70553bd] Inference time: 28.69 seconds, CPU usage: 70.0%, CPU core utilization: [68.6, 67.0, 70.7, 73.7] | |
| 2025-08-20 22:10:35 - INFO - [afa49686-78ae-46eb-b2a4-8f75a70553bd] Cleaned up temporary file: temp_videos/afa49686-78ae-46eb-b2a4-8f75a70553bd.mp4 | |
| 2025-08-20 22:10:35 - INFO - [afa49686-78ae-46eb-b2a4-8f75a70553bd] Cleaned up temporary frame directory: temp_videos/afa49686-78ae-46eb-b2a4-8f75a70553bd | |
| 2025-08-20 22:10:35 - INFO - [3afaa144-dd25-428a-99bf-293426382d0b] Received new video inference request. Prompt: 'Please describe the video in detail, only focus on customer and staff behavior and activities and do not overly describe the static scene.', Video: 'sample_part_001.mp4' | |
| 2025-08-20 22:10:36 - INFO - [3afaa144-dd25-428a-99bf-293426382d0b] Video saved to temporary file: temp_videos/3afaa144-dd25-428a-99bf-293426382d0b.mp4 | |
| 2025-08-20 22:10:36 - INFO - [3afaa144-dd25-428a-99bf-293426382d0b] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:10:44 - INFO - [3afaa144-dd25-428a-99bf-293426382d0b] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:10:44 - INFO - [3afaa144-dd25-428a-99bf-293426382d0b] 30 frames saved to temp_videos/3afaa144-dd25-428a-99bf-293426382d0b | |
| 2025-08-20 22:10:44 - INFO - Prompt token length: 3604 | |
| 2025-08-20 22:11:04 - INFO - Tokens per second: 40.60897346605822, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:11:04 - INFO - [3afaa144-dd25-428a-99bf-293426382d0b] Inference time: 28.89 seconds, CPU usage: 75.7%, CPU core utilization: [75.0, 65.5, 73.7, 88.6] | |
| 2025-08-20 22:11:04 - INFO - [3afaa144-dd25-428a-99bf-293426382d0b] Cleaned up temporary file: temp_videos/3afaa144-dd25-428a-99bf-293426382d0b.mp4 | |
| 2025-08-20 22:11:04 - INFO - [3afaa144-dd25-428a-99bf-293426382d0b] Cleaned up temporary frame directory: temp_videos/3afaa144-dd25-428a-99bf-293426382d0b | |
| 2025-08-20 22:11:05 - INFO - [5a1c46da-fc10-4080-a178-c2c775a7381d] Received new video inference request. Prompt: 'Please describe the video in detail, only focus on customer and staff behavior and activities and do not overly describe the static scene.', Video: 'sample_part_002.mp4' | |
| 2025-08-20 22:11:05 - INFO - [5a1c46da-fc10-4080-a178-c2c775a7381d] Video saved to temporary file: temp_videos/5a1c46da-fc10-4080-a178-c2c775a7381d.mp4 | |
| 2025-08-20 22:11:05 - INFO - [5a1c46da-fc10-4080-a178-c2c775a7381d] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:11:12 - INFO - [5a1c46da-fc10-4080-a178-c2c775a7381d] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:11:12 - INFO - [5a1c46da-fc10-4080-a178-c2c775a7381d] 30 frames saved to temp_videos/5a1c46da-fc10-4080-a178-c2c775a7381d | |
| 2025-08-20 22:11:13 - INFO - Prompt token length: 3604 | |
| 2025-08-20 22:11:35 - INFO - Tokens per second: 39.89175853584641, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:11:35 - INFO - [5a1c46da-fc10-4080-a178-c2c775a7381d] Inference time: 30.34 seconds, CPU usage: 77.2%, CPU core utilization: [74.2, 76.3, 80.4, 77.9] | |
| 2025-08-20 22:11:35 - INFO - [5a1c46da-fc10-4080-a178-c2c775a7381d] Cleaned up temporary file: temp_videos/5a1c46da-fc10-4080-a178-c2c775a7381d.mp4 | |
| 2025-08-20 22:11:35 - INFO - [5a1c46da-fc10-4080-a178-c2c775a7381d] Cleaned up temporary frame directory: temp_videos/5a1c46da-fc10-4080-a178-c2c775a7381d | |
| 2025-08-20 22:11:35 - INFO - [edf5e6ee-7477-451f-8335-8dd2e4335d67] Received new video inference request. Prompt: 'Please describe the video in detail, only focus on customer and staff behavior and activities and do not overly describe the static scene.', Video: 'sample_part_002.mp4' | |
| 2025-08-20 22:11:35 - INFO - [edf5e6ee-7477-451f-8335-8dd2e4335d67] Video saved to temporary file: temp_videos/edf5e6ee-7477-451f-8335-8dd2e4335d67.mp4 | |
| 2025-08-20 22:11:35 - INFO - [edf5e6ee-7477-451f-8335-8dd2e4335d67] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:11:42 - INFO - [edf5e6ee-7477-451f-8335-8dd2e4335d67] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:11:42 - INFO - [edf5e6ee-7477-451f-8335-8dd2e4335d67] 30 frames saved to temp_videos/edf5e6ee-7477-451f-8335-8dd2e4335d67 | |
| 2025-08-20 22:11:43 - INFO - Prompt token length: 3604 | |
| 2025-08-20 22:12:05 - INFO - Tokens per second: 39.00521947487598, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:12:05 - INFO - [edf5e6ee-7477-451f-8335-8dd2e4335d67] Inference time: 30.32 seconds, CPU usage: 79.7%, CPU core utilization: [79.9, 67.1, 78.2, 93.3] | |
| 2025-08-20 22:12:05 - INFO - [edf5e6ee-7477-451f-8335-8dd2e4335d67] Cleaned up temporary file: temp_videos/edf5e6ee-7477-451f-8335-8dd2e4335d67.mp4 | |
| 2025-08-20 22:12:05 - INFO - [edf5e6ee-7477-451f-8335-8dd2e4335d67] Cleaned up temporary frame directory: temp_videos/edf5e6ee-7477-451f-8335-8dd2e4335d67 | |
| 2025-08-20 22:12:06 - INFO - [0fddc63e-dbc6-4c80-8242-088580de8927] Received new video inference request. Prompt: 'Please describe the video in detail, only focus on customer and staff behavior and activities and do not overly describe the static scene.', Video: 'sample_part_003.mp4' | |
| 2025-08-20 22:12:06 - INFO - [0fddc63e-dbc6-4c80-8242-088580de8927] Video saved to temporary file: temp_videos/0fddc63e-dbc6-4c80-8242-088580de8927.mp4 | |
| 2025-08-20 22:12:06 - INFO - [0fddc63e-dbc6-4c80-8242-088580de8927] Extracting frames using method: uniform, rate/threshold: 30 | |
| 2025-08-20 22:12:13 - INFO - [0fddc63e-dbc6-4c80-8242-088580de8927] Extracted 30 frames successfully. Saving to temporary files... | |
| 2025-08-20 22:12:13 - INFO - [0fddc63e-dbc6-4c80-8242-088580de8927] 30 frames saved to temp_videos/0fddc63e-dbc6-4c80-8242-088580de8927 | |
| 2025-08-20 22:12:13 - INFO - Prompt token length: 3604 | |
| 2025-08-20 22:12:30 - INFO - Tokens per second: 41.222647353168156, Peak GPU memory MB: 9378.375 | |
| 2025-08-20 22:12:30 - INFO - [0fddc63e-dbc6-4c80-8242-088580de8927] Inference time: 24.71 seconds, CPU usage: 79.2%, CPU core utilization: [77.9, 74.8, 80.1, 83.8] | |
| 2025-08-20 22:12:30 - INFO - [0fddc63e-dbc6-4c80-8242-088580de8927] Cleaned up temporary file: temp_videos/0fddc63e-dbc6-4c80-8242-088580de8927.mp4 | |
| 2025-08-20 22:12:30 - INFO - [0fddc63e-dbc6-4c80-8242-088580de8927] Cleaned up temporary frame directory: temp_videos/0fddc63e-dbc6-4c80-8242-088580de8927 | |