{'fraction_non_alphanumeric': 0.01532567049808429, 'fraction_numerical': 0.001277139208173691, 'mean_word_length': 5.479338842975206, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A system for online compression of high-speed network measurements

Measuring metrics of high-speed networks produces large amounts of information over long periods of time, making the conventional storage of the data practically inefficient. Such metrics are derived from packet information and can be represented as time series signals. This paper looks at the Wavelet transform as a method of analysing and compressing measurement signals. A live system calculates these measurements and performs wavelet techniques to preserve the significant information and discard the small variations. An investigation of an appropriate wavelet is presented along with results from off-line and on-line experiments. Finally, a comparison of compression performance is presented against bzip2.