{'fraction_non_alphanumeric': 0.018518518518518517, 'fraction_numerical': 0.0, 'mean_word_length': 5.611111111111111, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Clustering and compression of high-dimensional sensor data

We investigate the compression of high-dimensional sensor data using vector quantization. Two metrics are presented for compression with the frequency sensitive competitive learning (FSCL) vector quantization (VQ) algorithm, and several indices of partitional validity are used to analyze the resulting VQ codebook clusters. Cluster analysis is used to determine the compressibility of the data. The results of this cluster analysis will help determine the effect of data compression on the performance of a target recognition system.