{'fraction_non_alphanumeric': 0.014035087719298246, 'fraction_numerical': 0.0, 'mean_word_length': 5.294117647058823, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Spectra using data distribution and covariance modelling

The autoregressive and Prony methods for spectral estimation do not make full use of the statistics of the additive noise. These statistics are included in the following as constraints on the solution. The finite number of data samples imposes a limit on the resolution thus making it possible to approximate random signals by a set of deterministic signals which can be modelled in terms of a finite set of time-invariant parameters, θ. The non-Toeplitz covariance calculated from the data is modelled here using the θ parameters. Statistical constraints and covariance modelling are combined to produce non-linear methods for spectral estimation. The resulting higher resolution requires high computational complexity; this can often be substantially reduced by using knowledge-based techniques.