{'fraction_non_alphanumeric': 0.02042711234911792, 'fraction_numerical': 0.0018570102135561746, 'mean_word_length': 5.493975903614458, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Developing recommender systems for personalized email with big data

Recommender systems are nowadays widely used in e-commerce industry to boost its sale. One of the popular algorithms in recommender systems is collaborative filtering. The fundamental assumption behind this algorithm is that other users' opinions can be filtered and accumulated in such a way as to provide a plausible prediction of the target user's preference. In this paper, we would like to develop a recommender system with big data of one e-commerce company and deliver the recommendations through a personalized email. To address this problem, we propose user-based collaboration filter based on company dataset and employ several similarity functions: Euclidean distance, Cosine, Pearson correlation and Tanimoto coefficient. The experimental results show that: (i) user responses are positive to the given recommendations based on user perception survey (ii) Tanimoto coefficient with 10 neighbors shows the best performance in the RMSE, precision and recall evaluation based on groundtruth dataset.