{'fraction_non_alphanumeric': 0.019801980198019802, 'fraction_numerical': 0.0049504950495049506, 'mean_word_length': 5.220512820512821, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
KWISC — Dependency visualization for understanding context

We propose a dependency visualization method for understanding context, KWISC. KWISC displays dependency between bunsetsus in Japanese sentences. In particular, it splits sentences into bunsetsus and displays them hierarchically according to the depth of dependency, to understand context. In addition, KWISC is able to align two keywords respectively, while KWIC aligns one keyword. This helps to find collocations among words. Furthermore, KWISC is able to expand and collapse bunsetsus. It can shorten distances of collocating words since it shows only the main structure of sentences by collapsing the bunsetsus. Therefore, collocating words are easy to fit on the screen, and horizontal eye movement is decreased when we look for collocations. As an evaluation experiment, we have collected pairs consisting of a bunsetsu that includes a keyword and another bunsetsu on which it depends from 207,802 sentences in the EDR corpus, and have measured the distances between them in KWISC. As a result, it is confirmed that KWISC makes the distances shorter than the conventional methods, and we have shown that KWISC makes it easy to find collocations.