{'fraction_non_alphanumeric': 0.011111111111111112, 'fraction_numerical': 0.0, 'mean_word_length': 5.008333333333334, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A cluster validity index for fuzzy c-means clustering

This paper presents a new validity index for validation of the fuzzy partitions generated by the fuzzy c-means algorithm. The proposed validity index is based on the compactness and separation measure. The compactness measure is defined as the weighted square deviation of the intra cluster, and the separation measure is defined as the distance for the different fuzzy sets. There are high expectations of a large degree compactness and separation among clusters for a good fuzzy partition. The contrast experimental results with various indices show that the proposed index is more robust to the noise and can identify clusters with different densities and sizes.