{'fraction_non_alphanumeric': 0.01703800786369594, 'fraction_numerical': 0.005242463958060288, 'mean_word_length': 4.922480620155039, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
On the Predictability of the Prosody of Dialog Markers from the Prosody of the Local Context

Dialog markers, such as yeah and okay generally seem to fit smoothly in the flow of dialog, with prosody that is natural and appropriate for the local context. We here examine this effect, specifically looking at the predictability of the prosody of dialog markers from the prosody of the local context. Using 72 prosodic features representing the local context, we built simple models able to predict the average pitch, log energy, cepstral flux, and harmonic ratio for the 12 most common dialog markers of American English. The model’s predictions accounted for over a third of the variance in the observed prosody, showing a modest but meaningful context dependence.