{'fraction_non_alphanumeric': 0.01885014137606032, 'fraction_numerical': 0.0, 'mean_word_length': 5.2105263157894735, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Big data and collective intelligence

Nowadays the creation and accumulation of big data is an unavoidable process in a wide range of situations and scenarios. Smart environments and diverse sources of sensors, as well as the content created by humans, contribute to the big data's enormous size and characteristics. To make sense of the data, analyse and use these data, more and more efficient algorithms are being developed constantly. Still, the effectiveness of these algorithms depends on the specific nature of big data: analogue, noisy, implicit, and ambiguous. At the same time, there is the unavoidable scientific area of collective intelligence. It represents the capability of interconnected intelligences to collectively and more efficiently solve concrete problems than each individual intelligence would be able to do on its own. The paper presents an overview of recent achievements in big data and collective intelligence research areas. At the end, the perspectives and challenges of the common directions of these two areas will be discussed.