{'fraction_non_alphanumeric': 0.01335113484646195, 'fraction_numerical': 0.0, 'mean_word_length': 5.4655172413793105, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Coherence maintenance in human-machine dialogue: indirect antecedents and ellipses

The paper discusses the use of dictionaries for resolving referential ambiguity in dialogue. We present a heuristic algorithm for detection of the indirect antecedents for dialogue phrases based on the use of a dictionary of prototypic scenarios associated with each headword, as well as of a thesaurus of the standard type. The conditions for filtration of the candidates for the antecedent are presented. The structure of the prototypic scenarios dictionary is discussed. We also present an algorithm for reconstruction of elliptical phrases of a special kind: short clarifications, in dialogue using a kind of combinatory dictionary with similar heuristic rules.