{'fraction_non_alphanumeric': 0.025302530253025302, 'fraction_numerical': 0.0088008800880088, 'mean_word_length': 5.408450704225352, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Automatically Discovering Unknown Short Video Repeats

In this paper we propose an efficient and robust method to automatically discover unknown short video repeats with arbitrary lengths, from a few seconds to a few minutes, from large video databases or streams. The proposed method consists of non-uniform video segmentation, self-similarity analysis, locality sensitive hashing, and video repeat boundary refinement. In order to achieve efficient and accurate processing feature extraction and similarity measure are performed at two levels: video frame level and video segment level. Experiments are conducted on 12 hour CNN/ABC news, and 12 hour documentaries (Discovery and National Geography), high recall and precision of 98% - 99% have been achieved. Video repeats' boundaries can be located within several frames. Applying the proposed method for video structure analysis is also briefly discussed.