{'fraction_non_alphanumeric': 0.01411764705882353, 'fraction_numerical': 0.0, 'mean_word_length': 5.257352941176471, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Stochastic classification models

Two families of stochastic processes are constructed that are intended for use in
classification problems where the aim is to classify units or specimens or species on the basis of
measured features. The first model is an exchangeable cluster process generated by a standard
Dirichlet allocation scheme. The set of classes is not pre-specified, so a newunit may be assigned
to a previously unobserved class. The second model, which is more flexible, uses a marked point
process as the mechanism generating the units or events, each with its associated class and feature.
The conditional distribution given the superposition process is obtained in closed form for one
particular marked point process. This distribution determines the conditional class probabilities,
and thus the prediction rule for subsequent units.