{'fraction_non_alphanumeric': 0.019771071800208116, 'fraction_numerical': 0.0, 'mean_word_length': 5.456375838926174, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
What Do We Really Know about Wages? The Importance of Nonreporting and Census Imputation

In the most frequently used microdata sets, over a quarter of all respondents now refuse to answer some questions about their incomes. The Census Bureau has dealt with this problem, which has been increasing in severity over time, by imputing incomes of non-respondents. Their imputation procedure, called the "hot deck," essentially matches nonrespondents with demographically similar donors. In this paper we evaluate the census imputation methodology and raise some questions. First, the census procedure is tied to commonality of events in the population rather than the more appropriate informational content of regressors. Clearly, the census procedure severely understates income in certain occupations. Because it is based on the apparently invalid assumption that income does not affect reporting propensities, it most likely understates average incomes as well.