{'fraction_non_alphanumeric': 0.02927400468384075, 'fraction_numerical': 0.01053864168618267, 'mean_word_length': 5.195652173913044, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Lossless compression of NOAA-AVHRR satellite data

A high-performance lossless compression system for satellite NOAA data is developed. The data is called 'high resolution picture transmission' (HRPT) data, and consists of around 93 percent advanced very high resolution radiometer (AVHRR) multi-channel image data and 7 percent of miscellaneous data. In compressing the image portion, we classify each pixel into 10 different groups and apply a multi-channel prediction and a non-linear error conversion. The entropy coder is an arithmetic coder which is adaptive and regenerates the approximation of the statistical properties of the source as an initial probability table. To compress the non-image part, we used the general compressor (gzip). From experimental results, the original information is compressed down to 25 percent to approx. 40 percent.