{'fraction_non_alphanumeric': 0.019771071800208116, 'fraction_numerical': 0.001040582726326743, 'mean_word_length': 4.726190476190476, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
An iterative rating method: application to web-based conference management

Given a large set of items and a set of users, we consider the problem of collecting user preferences - or ratings - on items. The paper describes a simple method which provides an approximate solution to the problem without requiring each user to rate each item. The method relies on an iterative process. Each step, or ballot, requires each user to rate a sample of the items. A collaborative filtering algorithm is then performed to predict the missing ratings as well as their level of confidence (which is initially 0). Perfoming a new ballot allows to improve the accuracy of predictions. The administrator of the system is responsible for stopping the iteration when a satisfactory level is reached.We apply this method to the assignment of reviewers to papers prior to the review phase of conference management, and describe its implementation in the MYREVIEW web-based system.