{'fraction_non_alphanumeric': 0.023976023976023976, 'fraction_numerical': 0.003996003996003996, 'mean_word_length': 5.30188679245283, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Why k-Systems Methodology Works

k-Systems methodology takes an arbitrary finite valued multivariate real function and transforms it into a dimensionless (0,1) interval function with associated "marginal" equations. Computations are then performed on this function and its marginal equations invoking solely the principle of maximum entropy. Many traditional statistical measures are thereby computed in this context. The claim is that this constitutes a correct framework for these measures. This theory has many statisticians throwing up their hands in consternation. The principle of maximum entropy is somewhat mysterious itself, but now the k-systems (0,1) function no longer represents relative frequencies, and the principle of maximum entropy has only been applied and rationalized for relative frequencies. Puzzling questions arise Just what is this methodology doing, why does it seem to do it so well, and why and when is it correct? In this paper we explore the rationale behind k-systems.