{'fraction_non_alphanumeric': 0.022156573116691284, 'fraction_numerical': 0.011816838995568686, 'mean_word_length': 5.78, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
SOEP 2010 - Preparation of data from the New SOEP consumption module: Editing, imputation, and smoothing

This documentation describes the data preparation of the new consumption module in the German Socio-Economic Panel Study (SOEP) and introduces the content and structure of the generated dataset “hconsum.” In 2010, the SOEP for the first time included a detailed consumption module in the household questionnaire. This documentation discusses several methodological challenges of the new module and suggests possible remedies. The methodological challenges include inconsistencies between monthly and annual consumption information, missing values, and a high incidence of