{'fraction_non_alphanumeric': 0.03207547169811321, 'fraction_numerical': 0.03490566037735849, 'mean_word_length': 4.861878453038674, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Inter-Rater Reliability Of Objective Structured Long Examination Record.

BACKGROUND
Objective Structured Long Examination Record (OSLER) scale was introduced in 1997 by Gleeson to improve the long case examination. There is no psychometric evidence to support reliability of OSLER. This study was done to analyse inter-rater reliability of OSLER.


METHODS
Two groups of examiners assessed 105 students in long case examination of their final professional examination, using OSLER scale. Group 1 was composed of actual examiners while Group 2 was mock examiners. Kappa statistic and intraclass correlation coefficient (ICC) were used on SPSS 23 to calculate reliability.


RESULTS
Mean score awarded by actual examiners was 55.36 (SD=11.2) whereas mean score by mock examiners was 57.74 (SD=14.1). Cronbach's alpha was 0.586, Kappa was 0.019 whereas inter-rater reliability on ICC was 0.413.


CONCLUSIONS
Although OSLER is a practical modification of long case examination with good validity, the scale needs to be more structured to improve its reliability.