{'fraction_non_alphanumeric': 0.023446658851113716, 'fraction_numerical': 0.0, 'mean_word_length': 5.188405797101449, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Discourse understanding at the U. of Rochester

Current participants in the discourse understanding project at the University of Rochester are James Allen, Steven Small, Gary Cottrell, Alan Frisch, Andy Haas, Hans Koomen, Diane Litman, Lokendra Shastri, and Marc Vilain. The project is studying dialogues that concern some task that one agent is assisting the other to perform, or some complex behavior that one agent is attempting to explain to the other. Thus there is a well defined set of goals that are pursued throughout the dialogue. In such dialogues, there is extensive use of utterances that consist of short sentence fragments. In addition, clarification subdialogues arise frequently in which previous misunderstandings are corrected. In order to model such dialogues, many sources of knowledge must be exploited. In particular, we emphasize