{'fraction_non_alphanumeric': 0.0235626767200754, 'fraction_numerical': 0.011310084825636193, 'mean_word_length': 5.6375, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Spoken Document Confidence Estimation Using Contextual Coherence

Selecting well-recognized transcripts is critical if information retrieval systems are to extract business intelligence from massive spoken document databases. To achieve this goal, we target spoken document conﬁdence measures that represent the recognition rates of each document. We focus on the incoherent word occurrences over several utterances in ill-recognized transcripts of spoken documents. The proposed method uses contextual coherence as a measure of spoken document conﬁdence. The contextual coherence is formulated as the mean of pointwise mutual information (PMI). We also propose a smoothing method of PMI, which deals with the data sparseness problem. Compared to the conventional method, our smoothing technique offers im-proved correlation coefﬁcients between spoken document conﬁdence scores and recognition rates from 0.573 to 0.672. More-over, an even higher correlation coefﬁcient, 0.710, is achieved by combining the contextual-based and decoder-based conﬁdence measures.