{'fraction_non_alphanumeric': 0.020293122886133032, 'fraction_numerical': 0.0, 'mean_word_length': 5.3428571428571425, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Staged text clustering algorithm based on K-means and hierarchical agglomeration clustering

In order to achieve better clustering, a staged hybrid clustering algorithm SC-KH (Staged text clustering algorithm based on K-means and HAC) is proposed to overcome the shortcomings of low accuracy of K-means algorithm and high time complexity of hierarchical agglomeration clustering algorithm. The algorithm divides the clustering process into two stages: splitting and merging. The K-means algorithm is used in the splitting stage, and the k value and the initial clustering center are provided using the Canopy algorithm. The hierarchical agglomeration clustering algorithm is used in the merging stage. The experimental results show that the performance of the improved SC-KH algorithm is better than that of K-means and hierarchical agglomeration, and the clustering quality is improved.