{'fraction_non_alphanumeric': 0.016867469879518072, 'fraction_numerical': 0.0, 'mean_word_length': 5.819672131147541, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Simulating Dependencies to Improve Parse Error Detection

We improve parse error detection, weighting dependency information on the basis of simulated parses. Such simulations extend the training grammar, and, although the simulations are not wholly correct or incorrect—as observed from the results with different weightings for small treebanks—they help to determine whether a new parse fits the training grammar.