{'fraction_non_alphanumeric': 0.031834449318864005, 'fraction_numerical': 0.016912953128607713, 'mean_word_length': 5.369301470588235, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Rethinking gross anatomy in a compressed time frame: Clinical symptoms, not case studies, as the basis for introductory instruction

Abstract The goal of this observational study was to develop effective approaches to introduce first year medical students to gross anatomy/embryology in a compressed time frame. Pedagogical reorganization of anatomy instruction in the regions of Lower Extremity and Head and Neck was based upon core clinical conditions taught in second‐year and USMLE Step 1 board review courses. These conditions were not presented as clinical problems, as many students had limited prior training in medical terminology, but focused upon clinical symptoms, allowing for direct correlation of structure and function. Instruction stressed vocabulary acquisition and was extended to prepare for laboratory dissections. Overall methodology was multimodal, including “flipped” and traditional lectures, study of prosections/radiographs and small group laboratory review sessions. Content was significantly reduced: knowledge of muscle actions and innervations was required, not muscle origins and insertions. Performance was evaluated by criterion‐based written examinations that included a set of questions (34) asked repetitively over an 8 year period (n = 606 students) and by regional practical exams. Mean scores in all areas were sustained or numerically improved, despite the compression of instruction duration. Analysis showed no significant differences based upon question format or instructional modality. Despite the high performance levels, students needing assistance in learning could be identified by score distributions. A survey of students indicated that these changes effectively decreased stress and facilitated review for the USMLE Step 1 Board examination. These results suggest that training in gross anatomy can be modified to a compressed duration by instruction in the context of clinical symptomatology.

There have been few specific assessments of the effects of these curricular changes on knowledge of gross anatomy and published studies have reached diverse conclusions (Clunie, Morris, Joynes, & Pickering, 2018;Hołda et al., 2019). Student knowledge of anatomy as a whole has been reported as somewhat higher (Findlater, Kristmundsdottir, Parson, & Gillingwater, 2012), equivalent (Bergman, Prince, Drukker, van der Vleuten, & Scherpbier, 2008) or substantially lower (Hinduja, Samuel, & Mitchell, 2005;Hołda et al., 2019;Papa & Vaccarezza, 2013) in integrated/problem based curricula compared to traditional anatomy instruction. Understanding of surface anatomy (McKeown et al., 2003) and confidence in knowledge of anatomy (Farey et al., 2018) have also been reported as low following training in systems-based curricula. Comparison of scores on United States Medical Licensing Examination (USMLE) Step 1 and Step 2 examinations showed no significant differences between students trained in traditional or integrated anatomy courses (Cuddy, Swanson, Drake, & Pawlina, 2013), but those examinations provide only limited assessment of overall knowledge of anatomy.
Recent changes in medical education have also generated new problems related to student preparedness in gross anatomy and stress (Slavin, Schindler, & Chibnall, 2014). As anticipated in the Carnegie report (a major impetus for curriculum revision), the expansion of class sizes in many medical schools has increased "the diversity of prior knowledge, skills, and abilities that students bring with them to medical school" (Irby, Cooke, & O'Brien, 2010). Compression of the duration of instruction in anatomical sciences has been particularly disadvantageous and stressful for students with limited prior training as it requires simultaneous acquisition of the vocabulary and "grammar" of medicine (Bowen & ten Cate, 2017;Wilson-Anstey, Lambert, & Krog, 2019). The increase in student stress has recently been recognized as a major problem, with consequences in rising rates of attrition, alcohol dependency and even suicide among medical students (Dyrbye, Lipscomb, & Thibault, 2019;Dyrbye, Thomas, & Shanafelt, 2005;Hill, Goicochea, & Merlo, 2018;Jackson, Shanafelt, Hasan, Satele, & Dyrbye, 2016;Laitman & Muller, 2019). However, few studies have proposed specific methods for modifying medical curricula to decrease student stress.
The adverse effect on student well-being was also cited as a major impetus in the recent change in the USMLE Step 1 examination from numerical to pass/fail scoring (Committee to Evaluate the USMLE Program, 2020; Humphrey & Woodruff, 2020). Originally intended to inform a binary decision on licensure, the exam has, instead, been extensively utilized in ranking students for residency programs (Chaudhry, Katsufrakis, & Tallia, 2020;McGaghie, Cohen, & Wayne, 2011). A number of studies have found that this inadvertently led to the development of a self-directed, "parallel" curriculum, in which students focused, through third-party sources, upon clinical topics that were tested on the USMLE Step 1 exam, rather than basic science course material (Burk-Rafel, Santen, & Purkiss, 2017;Kumar et al., 2015).
In confronting these problems, many schools have adopted new approaches for establishing a strong basis of knowledge of anatomy within a clinical context (Bains & Kaliski, 2020;Brooks, Woodley, Jackson, & Hoesley, 2015;Willey, Lim, & Kwiatkowski, 2018). A number of studies have demonstrated the effectiveness of use of multimodal pedagogies (Estai & Bunt, 2016;Johnson, Charchanti, & Toupis, 2012;Klement, Paulsen, & Wineski, 2017) rather than single instructional methods. Multimodal teaching can increase the efficiency of instruction in students with diverse prior training in anatomy (Houser & Kondrashov, 2018) and may also aid to ameliorate some components of stress derived from compressed curricula (Slavin et al., 2014).
Similar changes in the duration of gross anatomy instruction have occurred at the Joan C. Edwards School of Medicine. This observational paper describes pedagogical changes that were developed in preparation for a compression of instruction duration in a new, fully integrated curriculum. A goal of these changes was to integrate content in Anatomy in the Pedagogy in the areas of Head and Neck and Lower Extremity based upon understanding the symptoms of core clinical conditions rather than full analysis of clinical problems, as many students lacked the background for meaningful diagnostic analysis (Al-Jamal, 2018; Bowen & ten Cate, 2017). These changes also sought to integrate the structure and format of the self-directed "parallel" curriculum into formal training in anatomy and clinical science (Committee to Evaluate the USMLE Program, 2020).
The major question (hypothesis) of this study was: can pedagogical changes maintain and consolidate learning in a compressed time frame, while decreasing student stress? In the following, data are reviewed that support this hypothesis. Furthermore, this method provided the context for instruction in anatomy further in the curriculum, could aid students in preparation for board examinations and permit identification of students needing assistance in learning (Gullo, McCarthy, Shapiro, & Miller, 2015;Zill, 2019).

| METHODS
Gross Anatomy Instruction and Evaluation-Gross anatomy has been consistently taught by body region at the Joan C. Edwards School of Medicine and evaluated by in-house (custom) written multiple-choice and regional laboratory practical examinations. Examinations were given at the end of study (or midpoint and end for Head and Neck) of each body region. Student scores and point biserial values of questions were obtained from ExamSoft records for the years 2014-2019 or from a website maintained by our school (OME Question Bank) for 2010-2013. Data on student performance on earlier written examinations (2005-2009) were derived from departmental grading reports and the accuracy of the data has been confirmed through records kept by other course faculty. These records were assembled into a long-term database on performance in a spreadsheet (Excel) file and mean percentage scores and standard deviations were calculated.
Mann-Whitney-Wilcoxon and Paired t tests were used to evaluate the significance of differences in performance using SPSS (v26 IBM) and SigmaStat software (Jandel Scientific). Data for figures were plotted as histograms and scatter plots in SigmaPlot (Jandel Scientific).
As written examinations after 2012 also include questions in other courses that were taught simultaneously, more specific evaluation of performance in gross anatomy was obtained through a database of select repeat questions (Joncas, St-Onge, Bourque, & Farand, 2018).   The shift to a clinical focus did not limit the extent of anatomy instruction. For example, the symptoms of Horner syndrome formed the basis for discussion of the structure of the autonomic nervous system ( Figure 3a). The pathways of sympathetics (divergent two neuron arcs) to the skin allow for synchronous activation of sweat glands in thermoregulation, with the consequence that damage produced dry F I G U R E 1 Duration of gross anatomy instruction-These plots compare the duration of instruction (number of days from start to completion of instruction) for Lower Extremity (left) and Head and Neck for years 2010 and 2017-2019 and reflect a substantial compression in the duration of study [Color figure can be viewed at wileyonlinelibrary.com] F I G U R E 2 Core clinical diseases syndromes used as a context for anatomy instruction-Instruction in the regions of Lower Extremity and Head and Neck was reorganized based upon a core set of clinical conditions. These conditions have been taught in second-year courses (diseases and therapeutics) and/or studied in USMLE Step 1 board review skin (anhydrosis). The requirements for control through descending pathways from the hypothalamus and activation and distribution through spinal and cranial nerves led to an understanding that Horner syndrome could result from damage at a number of anatomical locations, including cervical lesions (e.g., Pancost tumors) that can produce symptoms in the eye and face (ptosis, miosis).
The format of "flipped" instruction was also introduced in the academic year 2019-2020. Students were given short videos (typically less than 20 min) as an introduction to the anatomy of particular regions prior to lecture/discussion. In class, the content of the videos was discussed within the context of clinical conditions. For example, the basic anatomy of the spinal cord was introduced in video, including discussion of the sensory input and motor output pathways and extended to a description of the anatomy and normal functions reflex pathways. In class, the symptom of hyperreflexia formed the basis for extending learning to an understanding of the need for descending and local modulation of reflexes. Thus, the symptomatology of the clinical condition (spinal cord injury) formed the basis for discussion of structure and function, even when the order was arranged as basic science followed by clinical context. F I G U R E 3 Clinical/anatomical format and multimodal pedagogy-(a) Anatomical basis of symptoms of clinical syndromes-Predominant symptoms were identified for each clinical syndrome. The anatomical basis of that symptom was utilized to introduce discussion of the related body structures/systems. The detailed pathology was not discussed but provided a foundation for understanding the relationship between anatomical structure and function. (b) Laboratory dissection, prosections-All students participated in cadaver dissections, augmented by independent study of prosections with photographic and radiological images. Dissections were modified (e.g., brainstem) to maximize cognizance of three-dimensional structure [Color figure can be viewed at wileyonlinelibrary.com] However, some content was de-emphasized or eliminated to adapt to the time compression. The retention of rote memorization is strongly dependent upon the duration of study (Dempster, 1988). As instruction in Lower Extremity was limited to 6 days in 2019 (Figure 1), rote memorization was decreased and students were required to learn only muscle actions and innervations, not their origins and insertions (although identification of individual muscles on cadavers was still required on practical examinations). Knowledge of some origins/insertions was required when clinically or conceptually relevant: for example, in discussion of the symptoms of Gluteal Gait, the origin of the Gluteus medius muscle (lateral aspect of the ilium) was stressed as that contributed to understanding of the muscle action in shifting support of body load. In Head and Neck, students were no longer required to memorize all the branches of the maxillary artery, only those directly contributing to major clinical conditions (such as the middle [and accessory] meningeal arteries to epidural hematoma). However, instruction did include identification of the major branches of the external and internal carotid arteries which were tested on radiological images.
Most laboratory dissection sessions have been maintained during this period, augmented by a multimodal approach utilizing prosections and radiological images (Figure 3b). Students still performed extensive dissections of the Lower Extremity, with required identification of major structures on practical examinations. In Head and Neck, full dissections of the cranial cavity (preserving the brainstem), orbit, neck, and oral and nasal cavities (head bisection) were performed by students. However, other regions were studied only in prosection (e.g., joints of lower extremity, infratemporal fossa, suboccipital region) as dissection of these structures is more complex and time consuming. Study of prosections was facilitated by distribution of labeled photographic images of specimens although knowledge was tested in practical exams on the original specimens.
F I G U R E 4 Extended database for evaluation of student performance-(a) Data base for long term evaluation. In the period of 2005-2012, examinations in gross anatomy were given at the end of study of each body region and comprehensive final exams were given at the end of study of gross anatomy. Histogram of mean scores (+SD) of students (n = 592 students) indicate that performance was high and relatively constant. 3.3 | Multiyear data base for evaluating performance A multiyear data base of student exam scores was used to assess performance although long term comparisons were complicated by the introduction of other courses that were taught and tested simultaneously (gross anatomy was still a major focus).    Figure 5c shows plots of student performance on the types of questions from 2012 to 2019 (same data set as Figure 5a,b). There were no statistically significant differences in the mean scores (Vignette mean 91.5 ± 2.2 SD; Basic Science 93.3 ± 1.8 SD) or in comparison of individual questions over this period. In addition, changes in scores were calculated for successive years after their introduction to test whether students had prior knowledge of question repetition (Wood, 2009). The mean changes in scores of all 34 questions in the first 2 years was −1.5 ± 6.2 SD and only gradually increased as mean scores rose in successive years. Thus, students apparently had no prior knowledge of question repetition.

| Effects of instructional modality
The effects of "Flipped" lectures were also evaluated by using "repeat" questions on written examinations. Figure 5d is a plot of student performance on questions (n = 6) in areas of nervous system anatomy and reflex functions for the flipped lectures (2019) and for the same questions in previous years (2014)(2015)(2016)(2017)(2018) in which the material was presented by conventional lectures (total n = 490 students): The mean performance was slightly lower for the "flipped" lecture year when compared to conventional lectures (mean flipped 92.2 ± 5.7 SD; conventional 94.8 ± 4.9 SD) although this difference was not statistically significant. Mean scores on all "flipped" lecture questions were similar to the mean of all other repeat questions (91.8 ± 1.99 SD). Thus, student scores showed no correlation with pedagogical format.

| Identifying students needing assistance in learning
Previous studies have indicated that the scores on examinations in the first year of medical school can be used as a measure to identify students needing assistance in learning (Gullo et al., 2015). Study of student performance in gross anatomy indicated that scores on practical examinations could fulfill that function. Figure 6b is a plot of the number of students and the ranges of scores for practical examinations in Lower Extremity and Head and Neck for the years 2017-2019 (n = 242 students in 9 examinations). This plot shows a discrete group of students who did not achieve passing grades and the distribution of exam scores was strongly bimodal in some years.
These data indicate that, despite the high performance levels, a subset of students needing additional assistance in learning can still be identified.

| Survey of effects of curricular changes on learning and stress
To gain an initial measure of students' views of the effectiveness of the curricular changes, a survey was distributed to students by email

| DISCUSSION
The goal of the pedagogical changes described in this article was to adapt teaching of gross anatomy/embryology to a compressed duration of instruction while still preparing students for licensing examina-

| Instruction based upon symptoms, not clinical cases
Instruction in anatomy was reorganized and based upon the symptoms of clinical conditions rather than full case studies (Fan, Jiang, Shi, Wang, & Li, 2018;Neville, 2009). The conditions were specifically associated with or directly resulted from changes in anatomy at a macroscopic level. Instruction based upon symptoms was a useful way to "parse out" learning, in a number of ways: (a) this method per-

| Advantage: Learning the vocabulary of medicine and reduction of student stress
Limiting discussion to the anatomical basis of symptoms had important advantages over pedagogies based upon complete clinical problems. The effectiveness and efficiency of problem-based approaches depend upon the background and prior training of the student, which have become increasingly diverse. Anatomy is a language that is essential in developing the vocabulary of clinical medicine (Al-Jamal, 2018;Bowen & ten Cate, 2017). Clinical terminology is highly specific and widely utilized because, as noted by Bowen and ten Cate (2017) it is efficient in describing complex concepts with combinations of features and provides uniformity in communications among physicians. However, the medical lexicon ("talking like a physician," Bowen & ten Cate, 2017, p. 49) is often only acquired in medical school while vocabulary instruction is rarely discussed in the medical education literature. For many students, medical terminology is effectively a "foreign" language and, in teaching at a primary or undergraduate level, language instruction typically begins by establishing and defining a vocabulary in simple contexts and then building up to complex thoughts (Larson, Dixon, & Townsend, 2013). In the present study, lectures often utilized a "word of the day" (e.g., hernia) and precisely defined its meaning (displacement of a structure from its normal position) (Kearney & Levine, 2019). This basic but essential F I G U R E 6 Quantification of repeat questions and survey of students-(a) Biserial values-This graph plots the mean point biserial values (+SD) for repeat questions in both the areas of Lower Extremity and Head and Neck. The point biserial values showed considerable variability and were only weakly correlated with the mean performance (r 2 = .28). (b) Bimodal distribution of exam scores-This histogram plots the distribution on practical exams scores (mean Lower Extremity and Head and Neck, years 2017-2019). The distribution is bimodal and indicates that, despite the high mean scores, these examinations can still be used to identify students having difficulty in gross anatomy. (c) Survey of students-These histograms show responses of students to a survey (in Likert format, 5 strongly agree, 1 strongly disagree) on the positive effects of clinical/anatomical format (left), evaluating preparation for the USMLE Step 1 examination (middle) and effectiveness in reducing stress in learning (right) [Color figure can be viewed at wileyonlinelibrary.com] element is often neglected in other formats, such as "flipped" lectures or independent learning. Omitting vocabulary instruction produces considerable disparity between students that have prior training and students who are stressed by the requirement of looking up and learning many terms, particularly if the volume of material is increased while the duration of learning is decreased.
It is also important to note that an inherent limitation in multiplechoice examinations (such as the USMLE Step 1) is that the questions provide all the words rather than relying upon the students to choose and assemble those words. Insufficient understanding of the meanings of words may not be assessed but could be manifested in clinical choices later in training and practice (Hołda et al., 2019). In addition, repetition of presentation of clinical content (repeated case studies) does not insure comprehension of vocabulary. The duration of older, semester-length courses in Anatomy was effective in providing the repetition needed for language acquisition.
The survey that we distributed indicated that students perceive these changes as effectively preparing them for the LCME Step 1 examination. Furthermore, although responses were more diverse, a majority of students indicated that the format adopted reduced stress in learning. We plan to repeat and extend this survey in future years but, even within the limitations of parametric analysis of the Likert format (Sullivan & Artino, 2013), these data provide support for the idea that a Clinical/Anatomical approach and reduction of detail in initial learning can mitigate the deleterious effects of student stress (Dyrbye et al., 2019).

| Disadvantage: Elimination/reduction of content in anatomy
The decrease in duration of instruction presented a considerable obstacle to students' retaining the details of body structure. The retention of rote memorization has long been known to be strongly dependent upon the duration of study and spacing of instruction (Delaney, Godbole, Holden, & Chang, 2018;Dempster, 1988;Larsen, 2018;Morin et al., 2019). To adapt to the decreased duration of instruction (6 days for Lower Extremity) learning of muscle anatomy was reduced (only actions/innervations, not origins/insertions).
Although this had an immediate benefit in decreasing the informational load, it proved to be a "two-edged sword," as students reported difficulty of initial identification of muscles in laboratory dissection, which is based upon muscle origin/insertion as well as position. Also, learning of origins and insertions was still required for some muscles when that provided insight into the symptoms of clinical syndromes (e.g., Gluteal gait). However, knowledge of muscle actions and innervations still provided understanding of the relationship between muscle structure/function and also facilitated understanding of syndromes of nerve damage (Ghosh, 2017;Miller, Perrotti, Silverthorn, Dalley, & Rarey, 2002).
Detail in content was also decreased in teaching of the circulatory system by requiring learning only arterial branches of major clinical relevance (ex only meningeal branches of the maxillary artery).
However, identification of all branches was still required in laboratory dissection and in the interpretation and testing of arterial angiograms.
It is important to note that, concomitant with the decline in anatomy teaching, there has been a dramatic increase in the use and informational content of imaging techniques that require a detailed knowledge of three-dimensional body structure, although questions based upon images of anatomy have apparently been reduced in the USMLE Step 1 examination.
The reduction of content in anatomy may clearly be an impediment to a number of aspects of medical education, particularly training in specialties in which knowledge of anatomical detail is essential (e.g., orthopedics, surgery, neurosurgery, radiology). This could be resolved through supplementary instruction in more advanced courses in Anatomy introduced later into the curricula (Blunt & Blizard, 1975).
This was not reflected in test scores in the present study, as questions related to deleted content were also eliminated in assessment.

| Analysis of performance using an extended baseline and "repeat" questions
The multiyear database of student exam scores indicated that student performance in gross anatomy remained high even after curriculum changes that increased the number of courses taught simultaneously.
The development of long-term databases is important as errors in analysis of test scores may occur when performance is evaluated over a limited period (Gullo, 2016). Many older studies examined data over single or two year periods (e.g., Minhas, Ghosh, & Swanzy, 2012;Zhang, Fenderson, Schmidt, & Veloski, 2013). The differences in performance may not only reflect changes in pedagogy but other, more complex parameters that are only apparent when data are evaluated over longer time periods (e.g., Nieder & Borges, 2012). This is particularly important in comparing some forms of assessment, such as practical examinations, that are inherently variable as they often use student dissections as test material (discussed by Yaqinuddin, Zafar, Ikram, & Ganguly, 2013). These errors may not be apparent but may be detected if data are acquired and evaluated over longer time periods.
More specific analysis was possible using the subset of repeat questions (Joncas et al., 2018). As the goal was to optimize and assess establishment of a basic foundation of gross anatomy and the medical vocabulary, no changes were made to make these questions more discriminative. Analysis of test scores after introduction of the use of repeat questions showed small variations in performance that paralleled the scores on nonrepeat questions, indicating that students had no prior knowledge of question repetition (Wood, 2009). Changes were made in the text and distractors for some questions to insure their reliability (Deepak, Al-Umran, AI-Sheikh, Dkoli, & Al-Rubaish,-2015) but no consistent changes in performance were found after these changes. Consistently high performance was also evident in student scores on practical examinations which can test some aspects of anatomical knowledge more directly than written multiple choice tests (Ghosh, 2017;Schuwirth & van der Vleuten, 2004). In addition, we did not attempt to correlate these results with subsequent performance on USMLE Step 1 examinations as those tests are limited in their assessment of knowledge of anatomy and do not include item analysis of topics that could be specifically related to our curricular changes.
However, the sustained performance of students in repeat questions and practical examinations supports the conclusion that the pedagogical changes were effective in establishing a base of knowledge of anatomy even in a decrease period of instruction.

| Multimodal pedagogies
An important element in sustaining student performance in gross anatomy in a compressed duration was the use of multimodal pedagogies to reiterate terminology and increase the depth of knowledge of body structure. The benefit of use of diverse methods of instruction has now been demonstrated in a wide variety of studies (Estai & Bunt, 2016;Hu, Wattchow, & de Fontgalland, 2018;Klement et al., 2017;Johnson et al., 2012;Moro, Smith, & Stromberga, 2019). In the present study, both "flipped" and conventional lectures presented the same anatomical structures repeatedly in photographs and diagrams, as well as radiographic (X-ray), radiological (CT) and MRI images. In addition, "active" learning regularly was utilized as many of the same structures were then dissected in laboratory sessions, often on the same day (Ghosh, 2017). Laboratory sessions were essential in developing appreciation for anatomical variation. Spacing of repetition was also aided by subsequent small group laboratory review sessions that occurred prior to each examination.
These multimodal methods facilitated learning by students with diverse backgrounds, as evidence by the high performance on both written and practical examinations. Student feedback in course evaluations regularly cited these approaches as making subjects "easier to understand." In contrast, use of single pedagogies such as problemsolving or team based learning approaches have potential benefits in developing student cognition but at the expense of increasing stress (White et al., 2014). While changes in methods of assessment have been indicated to improve student well-being (Bloodgood, Short, Jackson, & Martindale, 2009;Wilkinson, 2011) there have been few proposals for changes in pedagogy to reduce stress (D'Eon, 2014; Lyndon et al., 2017). The present study suggests that establishing and directly assessing a vocabulary and base of anatomical knowledge can facilitate learning that can be applied to more complex clinical problems, with a concomitant and overall decrease in stress.

| Early identification of students needing assistance in learning
A goal of this study was to examine whether performance in gross anatomy could be used to identify students needing assistance in learning.
Analysis of examination scores showed that, despite high overall performance levels, it was possible to consistently identify a discrete group that had not achieved a passing grade. The specific causes of difficulties encountered by some students are unclear but may reflect their academic background and the lack prior training in Anatomy, which can impede acquisition of steric knowledge and formation of an internalized image of body structure needed for interpretation of radiographs, CT and MRI images (Houser & Kondrashov, 2018;Wish-Baratz, Gubatina, Enterline, & Griswold, 2019;Zill, 2016). Our school has developed methods for identification of students needing assistance in learning and the present results suggest that analysis of early performance in gross anatomy may be of value in that process (Gullo et al., 2015).

| Limitations of this study
"Ceiling Effect"-Student scores on recent gross anatomy tests were high (increasing from averages in the high 80s to low 90s) and potentially subject to a "ceiling effect" (Taylor, 2012), limiting their applicability in discriminating performance among students who achieve a passing grade (Cramer & Howitt, 2005). Ranking student performance was not our goal as our method has been to establish a core of knowledge and assess performance through questions that are criterionreferenced (evaluating a specific body of anatomical knowledge as a fixed criterion) rather than norm referenced (assessing differences in abilities among test-takers) (Glaser, 1963). Due to the changes in our pedagogy, examinations have essentially become screening or threshold tests rather than rating tools, with the goal of aiding students in establishing a base of knowledge of the anatomical basis of clinical medicine which could then be expanded in further training (Shepard, 2018). While scores prior to 2016 showed normal distributions, analysis of repeat questions required use of nonparametric tests that do not require normal distributions (e.g., Wilcoxon test) to demonstrate that performance was consistent. In addition, a significant but small percentage of students did not pass these tests, indicating that some individuals found them challenging. We plan to re-evaluate the repeat questions (Boone, 2016) to increase our ability to identify students needing assistance in learning by increasing the number of clinical conditions studied and by introducing other measures of assessment, such as grading laboratory dissections (Nwachukwu, Lachman, & Pawlina, 2015). Use of multiple metrics of assessment has been suggested as a method increasing the reliability of pass/fail examinations (Möltner, Tımbıl, & Jünger, 2015) and has also been discussed as applicable to the consequences of the proposed changes in the USMLE Step 1 examination to a pass/fail format (Swails, Aibana, & Stoll, 2019).
Limitations of observational studies-In addition, this article was an observational study done without a control group (Rosenbaum, 2009), due mainly to constraints in the number of anatomy faculty.
Although this study has shown that student performance was consistently high and did not decrease through curricular changes that compressed the duration of gross anatomy instruction, we did not demonstrate a direct correlation between the modifications of pedagogy and test scores, as the teaching methods were applied to all students. The accuracy of measurement of changes in knowledge of anatomy was aided by the use of repeat questions over an eight-year period, which eliminated variations due to question format, distractors, etc. and supported by the finding that comparable changes occurred in both written and practical examinations (McKillip, 1992).
We believe that the consistency (not improvement) in those data support the idea that instruction in gross anatomy was effective despite the compression of duration. In addition, comparison of block exam scores in Head and Neck and Lower Extremity with assessment of teaching of anatomy in other regions, in which pedagogy was not comparably changed, supports the idea that methods we used were beneficial. However, further confirmation is needed and studies are planned to assess the effects of integration by other methods, such as tests of retention of anatomical knowledge in students at more advanced stages of undergraduate training.
Last, we also plan to repeat and expand the survey on student stress to confirm the effects of curricular changes on student wellbeing and to correlate the effects with specific pedagogical methods.
In sum, we believe our data support the idea that pedagogical changes can be effective in teaching gross anatomy in a limited time frame and these methods may benefit others confronting the changes in anatomy instruction in medical education.