{'fraction_non_alphanumeric': 0.022380467955239063, 'fraction_numerical': 0.008138351983723296, 'mean_word_length': 5.648648648648648, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Automatic Reconstruction of Utterance Boundaries Time Marks in Speech Database

In this paper, an algorithm performing automatic reconstruction of utterance boundaries time marks in speech database re-grabbed from DAT recorder is presented. Originally, the database was grabbed from DAT and, after down-sampling, processed at 16 kHz. Utterance boundaries were manually found, each utterance was stored to a separate file and orthographic and phonetic transcriptions were performed. Recently, a requirement to re-grab and process the database at 48 kHz has appeared. Since positions of utterance boundaries were known for 16 kHz, it was reasonable to use this information for the 48 kHz processing. Unfortunately, re-grabbed sessions displayed certain length changes compared to the originally grabbed data. Presented algorithm finds session boundaries, matches session lengths and calculates actual utterance boundaries positions. Finally, matching accuracy is automatically checked.