{'fraction_non_alphanumeric': 0.013245033112582781, 'fraction_numerical': 0.0, 'mean_word_length': 5.4361702127659575, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Skyline Based Search Result Diversification Method

There are high redundancy and low diversity problems existing in current search engines. To solve this problem, a skyline based search result diversification method was proposed. The search results were sorted in accordance with skyline level, domination degree and coverage. In order to reduce the time cost, a bitmap based skyline level and domination degree computing algorithm was designed. Experimental results show that the proposed method can achieve better performance in terms of search results diversity and skyline level computing time cost.