{'fraction_non_alphanumeric': 0.02330827067669173, 'fraction_numerical': 0.015037593984962405, 'mean_word_length': 5.162037037037037, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A system for large-scale analysis of distributed cameras

Thousands of cameras are connected to the Internet providing streaming data (videos or periodic images). The images contain information that can be used to determine the scene contents such as traffic, weather, and the environment. Analyzing the data from these cameras presents many challenges, such as (i) retrieving data from geographically distributed and heterogeneous cameras, (ii) providing a software environment for users to simultaneously analyze large amounts of data from the cameras, (iii) allocating and managing computation and storage resources. This paper presents a system designed to address these challenges. The system enables users to execute image analysis and computer vision techniques on a large scale with only slight changes to the existing methods. It currently includes more than 65,000 cameras deployed worldwide. Users can select cameras for the types of analysis they can do. The system allocates Amazon EC2 and Windows Azure cloud instances for executing the analysis. Our experiments demonstrate that this system can be used for a variety of image analysis techniques (e.g. motion analysis and human detection) using 2.7 million images from 1274 cameras for three hours using 15 cloud instances to analyze 141 GB of images (at 107 Mbps).