{'fraction_non_alphanumeric': 0.011668611435239206, 'fraction_numerical': 0.0, 'mean_word_length': 4.836734693877551, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Optimization of Frequency Table Storage in Constant Grade Compression

In order to improve the efficiency of constant grade compression, it is necessary to save the space occupied by frequency table. Theory of constant grade compression is expatiated in this paper. Since this compression method is related to the frequency of the subsection to be compressed, we make a research on the distribution of the byte frequency. Due to the random subsection content, it is found that frequency times are more in the areas which near the average frequency value and the times are less in the areas which is far from the average frequency value. According to the distribution features of the character, the storage of frequency table is optimized. The different prefix codes are adopted to express the frequencies in different areas so as to save more storage space.