{'fraction_non_alphanumeric': 0.016611295681063124, 'fraction_numerical': 0.0, 'mean_word_length': 5.414893617021277, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Scalable near-duplicate video stream monitoring

In this paper, we present a simple but effective algorithm to address the efficiency problem of video stream near-duplicate monitoring in a large-scale repository. In the algorithm, a similarity upper bound between two sequences is calculated incrementally and served as a rough filter to avoid time-consuming computation for the true sequence similarity. It makes the scan process more efficient and guarantees no true positive is missed. Our experiments demonstrate the proposed algorithm yields accurate retrieval result and efficient execution time.