{'fraction_non_alphanumeric': 0.01828410689170183, 'fraction_numerical': 0.0, 'mean_word_length': 5.472727272727273, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Study on the Optimization Design of the Subject Indexing Based on the Word-frequency Statistics

Based on the traditional word frequency statistical function, the new weighting function is established in this article, comprehensively combining with four important factors such as the weight value of subject words, the classes, the specificity, and the cohesion relation. This new method could standardize the indexing of the subject words of the official document, enhance the work efficiency, realize the automatic indexing, and reduce the mistakes because of personal factors. In addition, the program design and the implementation of the computer language of this method are also introduced in this article.