{'fraction_non_alphanumeric': 0.008962868117797696, 'fraction_numerical': 0.0, 'mean_word_length': 5.683760683760684, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Neural network data clustering on the basis of scale invariant entropy

A new method for data clustering is proposed. The method uses generalized scale invariant concept of distance measure and data entropy. The analysis of analogy between known Euclidean metric and the proposed measure allows constructing an effective clustering algorithm. The developed technique enables grouping of heterogeneous data regardless of the measuring scale chosen and can be used in different applications. The demonstration examples of clustering Iris flower data and Wine recognition data are considered. New algorithm shows low error rate for the examined data sets surpassing traditional algorithms derived from Euclidean metrics, whereas simultaneously preserving the scale invariant property.