{'fraction_non_alphanumeric': 0.015586546349466776, 'fraction_numerical': 0.0, 'mean_word_length': 5.594594594594595, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
On the Blessing of Abstraction

The “blessing of abstraction” refers to the observation that acquiring abstract knowledge sometimes proceeds more quickly than acquiring more speciﬁc knowledge. This observation can be formalized and reproduced by hierarchical Bayesian models. The key notion is that more abstract layers of the hierarchy have a larger “effective” sample size, because they combine information across multiple speciﬁc instances lower in the hierarchy. This notion relies on speciﬁc variables being relatively concentrated around the abstract “overhypothesis”. If the variables are highly dispersed, then the effective sample size for the abstract layers will not be appreciably larger than for the speciﬁc layers. Moreover, the blessing of abstraction is counterbalanced by the fact that data are more informative about lower levels of the hierarchy, because there is necessarily less stochasticity intervening between speciﬁc variables and the data. Thus, in certain cases abstract knowledge will be acquired more slowly than speciﬁc knowledge. This paper reports an experiment that shows how manipulating dispersion can produce both fast and slow acquisition of abstract knowledge in the same paradigm.