{'fraction_non_alphanumeric': 0.008955223880597015, 'fraction_numerical': 0.0, 'mean_word_length': 5.917525773195877, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A weighted sifting method to improve the effectiveness of collaborative filtering

In this paper, we improve the accuracy of the conventional collaborative filtering algorithm by proposing a weighted sifting method. The weighted sifting method preprocesses the given customer data to generate an adjusted customer data which we believe contains less noise than the original one, and thus effectively discriminates the preference weights of items for each customer. We present two alternative calculation methods for weight adjustment, and our experimental evaluation shows that both calculation methods result in better accuracy than traditional collaborative filtering.