{'fraction_non_alphanumeric': 0.01953125, 'fraction_numerical': 0.0, 'mean_word_length': 5.629310344827586, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Analysis of multiple specifications: statistical validity and a Bayesian proposal

A key issue in science is assessing robustness to data analysis choices, while avoiding selective reporting and providing valid statistical inference. Specification Curve Analysis is a tool to prevent selective reporting. Alas, it can create false positives, due to wrongly adjusting treatment effects. Moreover, its summary statistics can mask important heterogeneity. For example, they led an influential study to conclude there is no relevant association between technology use and teenager mental well-being. We discuss these issues and propose a strategy for valid statistical inference. Our results reconcile some conflicting findings on technology use and adolescent well-being.