{'fraction_non_alphanumeric': 0.01371571072319202, 'fraction_numerical': 0.0, 'mean_word_length': 5.863247863247863, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Intelligent Transcription System Based on Spontaneous Speech Processing

With the improvement of the speech recognition technology, semi-automatic generation of transcripts or document records of lectures and meetings has become one of its promising applications. For this purpose, we need to take into account post-processing that includes cleaning of verbatim transcripts and segmentation into sentence and paragraph units. This article presents a novel statistical framework for an intelligent transcription system. The recent progress of automatic speech recognition of lectures and meetings is also reported. Then, several approaches to sentence unit detection and disfluency detection are described, as they are significant in the post-processing of transcripts generated by the speech recognizer