{'fraction_non_alphanumeric': 0.02386634844868735, 'fraction_numerical': 0.00477326968973747, 'mean_word_length': 5.2611940298507465, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Robustness of Logit Analysis: Unobserved Heterogeneity and Mis-Specified Disturbances

In probit and logit models, the co-efficients vary inversely with the variance of the disturbances. The omission of a relevant orthogonal regressor leads to increased unobserved heterogeneity, and this depresses the coefficients of the remaining regressors towards zero. For the probit model, Wooldridge (Econometric Analysis of Cross Section and Panel Data, MIT Press, Cambridge, MA, 2002) has shown that this bias does not carry over to the effect of these regressors on the outcome. We find by simulations that this also holds for the logit model, even when omitting a variable leads to severe mis-specification of the disturbance. More simulations show that logit analysis is quite insensitive to pure mis-specification of the disturbance as such.