{'fraction_non_alphanumeric': 0.016835016835016835, 'fraction_numerical': 0.0, 'mean_word_length': 5.151724137931034, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
The design of a multi-concept image retrieval system based on Hadoop and GMM

The multi-concept image annotation and retrieval are popular for semantic image retrieval which needs to establish the relations between multi-linguistic labels and one image. So the probabilistic formulation for semantic labeling is introduced to solve it. However, the training process of the Gaussian Mixture Model classifiers needs a large amount of computation, especially when the image sets is huge. Hadoop is the open source software that has powerful parallel computing ability and big data processing capacity. In this paper, we introduced the GMM which is used for the likelihood computation for the linguistic indexing, and the Hadoop that can solve the computation complexity with the MapReduce framework. We will show our ideas, designs and realizations of this multi-concept image retrieval system.