{'fraction_non_alphanumeric': 0.020054694621695533, 'fraction_numerical': 0.007292616226071103, 'mean_word_length': 4.967391304347826, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Application of Varint_LZW encoding algorithm in image compression

The rapid development of information technology has brought tremendous pressure to data transmission and compression, so data compression has great significance. Data compression before transmission can reduce transmission bandwidth, and data compression before storage can reduce data storage. The Lempel-Ziv-Welch (LZW) coding process has a very high requirement on the bit width of the data cached in the dictionary in RAM for such images with the same color appearing continuously. LZW is used to encode the same 16-bit pixel data continuously. When the data is encoded to 128 pixels, the 128bit wide RAM will be filled up. If the same data is continued to be encoded, the RAM will overflow the data. In this paper, Varint encoding algorithm is introduced to solve this problem, and Varint encoding is carried out before LZW encoding. Varint has good compression effect on high continuous and repeated data. Therefore, for this type of data, Varint_LZW encoding shows lower utilization rate of RAM bit width than LZW encoding.