{'fraction_non_alphanumeric': 0.017964071856287425, 'fraction_numerical': 0.0, 'mean_word_length': 5.057971014492754, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Cross-entropy approach to data visualization based on the neural gas network

A new approach to mapping high dimensional data into a low dimensional space embedding is presented. The aim of this approach is to project simultaneously the input data and the codebook vectors into a low dimensional output space, preserving the local neighborhood. The neural gas algorithm is used to obtain codebook vectors. A cost function based on the cross entropy (CE) between input and output probabilities is minimized by using a Newton-Raphson method. The new approach is compared with multidimensional scaling (MDS) using a benchmark data set and three high dimensional real world data sets. In comparison with MDS, our method delivers a clear visualization of both data points and codebooks, and better CE and topology preservation measurements.