{'fraction_non_alphanumeric': 0.014693171996542784, 'fraction_numerical': 0.0, 'mean_word_length': 5.094736842105263, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Mining frequent rooted subtrees in XML data with Me-Tree

Due to the rapid progress of network and storage technologies, a huge amount of electronic data such as Web pages and XML data has been available on Internet. These weekly-structured documents have no rigid structures, and often called semistructured data. Hence, there have been increasing demands for efficient methods for discovering patterns in large collection of semistructured data. We study a data mining problem of discovering frequent subtrees in a large collection of XML data, where both of the patterns and the data are modeled by labeled ordered trees. We present an efficient algorithm RSTMiner that computes all rooted subtrees appearing in a collection of XML trees with frequent above a user-specified threshold using a special structure Me-tree. In this algorithm, Me-tree is used as a merging tree to supply scheme information for efficient pruning and mining frequent subtrees. The keys of the algorithm are efficient pruning candidates with Me-Tree structure and incrementally enumerating all rooted subtrees in canonical form based on a extended right most expansion technique