{'fraction_non_alphanumeric': 0.011363636363636364, 'fraction_numerical': 0.0, 'mean_word_length': 5.634408602150538, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Matrix computation for data cleaning and rule extraction in knowledge system

The concept of equivalence matrix, which expresses an equivalence relation, is introduced. The relations between the equivalence matrix and equivalence classes are discussed. The proposed algorithms for data cleaning and rule extraction in the knowledge system based on matrix computation and its complexity of computation are analyzed. All rules hidden in the knowledge system can be obtained efficiently via this methodology. The algorithms emphasize the practicability of rule generation and a case study indicated their effectiveness.