{'fraction_non_alphanumeric': 0.012698412698412698, 'fraction_numerical': 0.0, 'mean_word_length': 5.103225806451613, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Block codes for statistical synchronization

The performance of a class of block codes with unbounded synchronization delay, though finite average synchronization delay, is analyzed. Basically the synchronizer inspects the code symbol stream for the first occurrence of one of a set of sequences that appear in only one timing position relative to true sync. The receiver can be implemented easily with shift registers and associated logic. The probability that the sync process will exceed any given number of code symbols is investigated and bounds on this probability are established. The average sync delay to the first occurrence of a synchronizing sequence is determined and the optimal encoding procedure for a memoryless message source is presented. If sync is established by observing an n -tuple, n being the codeword length, the optimal structure of the synchronizing n -tuple is found and the associated dictionary size is specified.