{'fraction_non_alphanumeric': 0.014719411223551058, 'fraction_numerical': 0.0, 'mean_word_length': 4.881081081081081, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Information Selective Processing in the Complex Projects Examination the principle of equal complexity

The problem of detecting errors and improving a complex large-scale project is considered as the task of data mining. A selective research model of such project is designed. The task is to select the information files of the project, the expertise of which ensures the best achievement of the goal (for example, the maximum reduction in the cost of the project). Its decision is based on the principle of equal job complexity: modules from files studied by experts of the same qualification should be equal in complexity. A heuristic algorithm for such a solution is described. The problem of estimating the necessary number of experts is considered and solved on the basis of an assessment of the overall job complexity, taking into account the costs of their coordination. Based on the results obtained and the principles of data mining an approach to the examination of complex large-scale projects is developed. This approach is illustrated by examples in the field of transport.