{'fraction_non_alphanumeric': 0.01411764705882353, 'fraction_numerical': 0.0, 'mean_word_length': 5.700787401574803, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Probabilistic Representation of Complexity

We study individuals' behavior in an environment that is deterministic, but too complex to permit tractable deterministic representation. Under mild conditions, behavior is represented by a unique probabilistic model in which the agent's inability to think through all contingencies of the problem translates into uncertainty about random states. We interpret this probabilistic model as embodying all patterns the agent perceives in his environment, yet allowing for the possibility that there may be important details he had missed. The implied behavior is rational in the traditional sense, yet consistent with an agent who believes his environment is too complex to warrant precise planing, foregoes finely detailed contingent rules in favor of vaguer plans, and expresses a preference for flexibility.