{'fraction_non_alphanumeric': 0.01756198347107438, 'fraction_numerical': 0.004132231404958678, 'mean_word_length': 5.971223021582734, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
The Role of Psychometric Modeling in Test Validation: An Application of Multidimensional Item Response Theory

However, this separation can be viewed as artificial (Marcoulides, 2004) and we believe that test validation must necessarily employ psychometric modeling to investigate key assumptions and inferences. Such an investigation intimately connects psychometric modeling to substantive concerns and provides a gateway for the relevance of psychometrics in educational and psychological research. In this paper we examine the role of item response theory (IRT), particularly multidimensional item response theory (MIRT) in test validation from a validity argument perspective. Our conceptualization of the interpretive argument differs from Kane in that it combines his second and third inference—generalization from the test score to the expected score over the test domain and extrapolating from test domain to the knowledge/skill/judgment domain—into a general