{'fraction_non_alphanumeric': 0.013402061855670102, 'fraction_numerical': 0.0, 'mean_word_length': 5.34640522875817, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A novel validity measure for clusters of arbitrary shapes and densities

Several validity indices have been designed to evaluate solutions obtained by clustering algorithms. Traditional indices are generally designed to evaluate center-based clustering, where clusters are assumed to be of globular shapes with defined centers or representatives. Therefore they are not suitable to evaluate clusters of arbitrary shapes and densities, where clusters have no defined centers or representatives, but formed based on the connectivity of patterns to their neighbours. In this work, a novel validity measure based on a density-based criterion is proposed. It is based on the concept that densities of clusters can be distinguished by the neighbourhood distances between patterns. It is suitable for clusters of any shapes and of different densities. The main concepts of the proposed measure are explained and experimental results that support the proposed measure are given.