{'fraction_non_alphanumeric': 0.022326674500587545, 'fraction_numerical': 0.0, 'mean_word_length': 5.454545454545454, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Holistic Grading of Written Work in Introductory Psychology: Reliability, Validity, and Efficiency

Written assignments in large classes can be made practical by the use of holistic scoring. Data are presented to show the reliability, validity, and efficiency of adapting holistic scoring to written work in an introductory psychology course in which the grading was done entirely by a teaching assistant (TA). Separate criteria were used to score the content and writing skill of paragraph-length essay-test answers and short-paper assignments, Judgments of writing skill made by psychology TAs using holistic criteria were reliable and compared favorably with writing-skill judgments made by experienced English composition instructors. We conclude that holistic scoring is a high-quality, low-cost approach to scoring written work in large classes.