{'fraction_non_alphanumeric': 0.03954848809425723, 'fraction_numerical': 0.019362280629480103, 'mean_word_length': 5.176844783715013, 'pattern_counts': {'":': 0, '<': 12, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Adverse drug events leading to emergency department visits: A multicenter observational study in Korea

Adverse drug events are significant causes of emergency department visits. Systematic evaluation of adverse drug events leading to emergency department visits by age is lacking. This multicenter retrospective observational study evaluated the prevalence and features of adverse drug event-related emergency department visits across ages. We reviewed emergency department medical records obtained from three university hospitals between July 2014 and December 2014. The proportion of adverse drug events among total emergency department visits was calculated. The cause, severity, preventability, and causative drug(s) of each adverse drug event were analyzed and compared between age groups (children/adolescents [<18 years], adults [18–64 years], and the elderly [≥65 years]). Of 59,428 emergency department visits, 2,104 (3.5%) were adverse drug event-related. Adverse drug event-related emergency department visits were more likely to be female and older. Multivariate logistic regression analysis revealed that compared to non- adverse drug event-related cases, adverse drug event-related emergency department visitors were more likely to be female (60.6% vs. 53.6%, p<0.001, OR 1.285, 95% CI 1.025–1.603) and older (50.8 ± 24.6 years vs. 37.7 ± 24.4 years, p<0.001, OR 1.892, 95% CI: 1.397–2.297). Comorbidities such as diabetes, chronic kidney disease, chronic liver disease, and malignancies were also significantly associated with adverse drug event-related emergency department visits. Side effects were the most common type of adverse drug events across age groups, although main types differed substantially depending on age. Serious adverse drug events, hospitalizations, and adverse drug event-related deaths occurred more frequently in the elderly than in adults or children/adolescents. The proportion of adverse drug event-related emergency department visits that were preventable was 15.3%. Causative drugs of adverse drug events varied considerably depending on age group. Adverse drug event features differ substantially according to age group. The findings suggest that an age-specific approach should be adopted in the preventive strategies to reduce adverse drug events.


Introduction
The increase in the prevalence of chronic diseases and the development of therapeutic drugs has resulted in increased drug exposure in the population [1]. The increase in drug exposure has led to a rapid increase in the occurrence of adverse drug events (ADEs) [2]. In the United States (US), approximately 2.2 million people have been hospitalized due to ADEs [3]. Indeed, ADE is the fourth most common cause of death, resulting in 100,000 deaths annually [3]. ADE is a significant medical issue directly related to patients' life and socioeconomic factors.
Although most drugs are consumed outside hospitals, ADEs occurring in the outpatient setting are less extensively monitored than those occurring in hospitals. Monitoring of ADEs, which lead to emergency department (ED) visits, is a suitable approach to evaluate the occurrence of ADEs in outpatient settings [4]. Patients visit the ED when they experience serious ADEs in outpatient settings. In addition, since the causal relationships between drug administration and ADEs are relatively clear, it is easier to diagnose ADEs accurately [5]. Several studies have evaluated the prevalence and epidemiologic features of ADE-related ED visits by reviewing the medical records of patients visiting the ED [6][7][8][9]. Most studies were conducted in a single-center or a limited number of hospitals, with small sample size. Therefore, estimations of the prevalence and characteristics of ADE-related ED visits remain limited. Moreover, several reports based on nationwide databases or claims systems have been conducted. Cohen et al. analyzed ADE-related diagnostic codes in the National Electronic Injury Surveillance System-Cooperative Adverse Drug Event Surveillance (NEISS-CADES) system and evaluated the national estimates of ADE-related ED visits in children [10]. These studies have the advantage of estimating the prevalence at a nationwide level. However, considering that the negative predictive value of the ADE-related diagnostic code is low, these approaches may underestimate the prevalence of ADE-related ED visits in real life. In addition, it is difficult to evaluate the epidemiologic factors of ADE-related ED visits using these approaches.
Although ADE-related ED visits are a critical issue related to medication safety, the incidence, and epidemiologic characteristics of ADEs leading to ED visits have not been sufficiently studied. To estimate the true prevalence and the epidemiologic features of ADE-related ED visits, we conducted a multicenter pharmacoepidemiologic study based on a standardized protocol with many subjects who visited EDs at university hospitals.

Study design and protocol
In this multicenter retrospective observational study (PERADE), three tertiary university hospitals, namely, Hanyang University Hospital, Chung-Ang University Hospital in Seoul, and Chungbuk National University Hospital in Cheongju, Korea, participated. These hospitals share many common features. First, all three hospitals were designated as Regional Emergency Medical Centers by the Ministry of Health and Welfare of Korea. The National Emergency Department Information System (NEDIS), which is a representative nationwide system that collects clinical and administrative data on patients who visit the ED in Korea, has been implemented in all three hospitals. The NEDIS database contains key clinical information such as demographics, clinical information, initial vital signs, initial diagnosis, treatment outcomes, and dispositions, enabling each hospital's researchers to conduct the evaluation based on the same data format. Further, each hospital actively operates the Regional Pharmacovigilance Centers under the supervision of the Korea Institute of Drug Safety and Risk Management (KIDS) and the Korea Ministry of Food and Drug Safety. These hospitals operate similar pharmacovigilance systems and ADE-reporting systems to the KIDS.
To minimize heterogeneity in assessing ADEs between organizations and researchers, we generated a standardized written study protocol. We specified the purpose and outcomes of the study, the definition of ADEs, inclusion or exclusion criteria for cases, and outcomes for analyses. The ongoing status and preliminary results of the study were shared with other hospitals through regular research meetings to ensure that each institution conducted evaluations based on the same protocols, and consequently reduced the heterogeneity of reviewing processes between hospitals. Using a secured web-based electronic case report form (e-CRF), we stored and managed the data from the patients who visited the ED. Data quality management was performed by reducing errors, duplication, and omission of essential items and increasing fidelity.

Subjects and case definition of ADEs
The study subjects were patients who visited the EDs of three hospitals over a 6-month study period, from July 2014 to December 2014. We thoroughly evaluated the study participant's electronic medical records (EMRs) during ED visits as well as for 1 year before and after ED visits. Fully anonymized information on the study subjects was extracted from electronic medical records (EMRs) and the NEDIS database of each hospital and uploaded on the e-CRF. An ADE was defined as untoward and unintended events arising from the use or misuse of medications. Using a two-step approach, detailed information regarding each ED visit was reviewed to determine ADEs based on information from the e-CRF and EMRs. In the first review, each case was screened and categorized as low, intermediate, or high possibility of ADE. Subsequently, pharmacovigilance and allergy specialists confirmed ADEs from intermediate or high possibility of ADEs by assessing causality categories based on the World Health Organization-Uppsala Monitoring Center (WHO-UMC) criteria [11]. ADE cases scored as certain, probable, or possible were included as ADEs, whereas the cases with unlikely, unclassified, or unclassifiable causalities were excluded. For each ADE, the diagnosis was coded according to the Korean Classification of Disease version-6 (KCD-6), and the name of the ADE was coded according to the preferred terms (PTs) or included terms (ITs) based on the World Health Organization-Adverse Reaction Terminology (WHO-ART) version 092 [12]. Culprit medications were coded to the WHO Anatomical Therapeutic Classification (ATC) system. This study was approved by the Institutional Review Boards of Hanyang University Hospital (IRB 2015-08-004), Chung-Ang University Hospital (IRB C2015174-1632), and Chungbuk National University Hospital (IRB 2015-06-018). The ethics committee from each hospital waived the need for informed.

Main outcomes of ADEs
As major outcomes of each ADE case, we determined the causes (mechanisms), severity, preventability, and causative drugs based on the standardized protocols of this study. Types of ADE were classified as follows: side effect, overdose, secondary effect, drug interaction, allergy, or non-allergic hypersensitivity reaction. Additionally, ADEs related to poor compliance, dose reduction discordant with physicians' opinion, or discontinuation of therapy were included in this analysis [13]. ED visits associated with intentional overdose, drug abuse, and/or suicidal attempts were excluded from this study. The severity of ADEs was categorized into mild, moderate (needed treatment but recovery was possible), or severe (needed hospitalization or possibility of disability) [14]. The suspected ADEs were further analyzed for assessing the preventability by Schumock and Thornton algorithm [15]. Preventability of ADEs was defined when meeting any one of the following: drug inappropriate for a clinical condition; inappropriate dose, route, or frequency of administration; required therapeutic drug monitoring or lab test not performed; and history of allergies or hypersensitivity, drug interaction, toxic drug levels, and poor compliance.

Statistical analysis
All statistical analyses were performed using IBM Statistical Product and Service Solutions (SPSS Statistics for Windows, version 22.0; IBM Corp., Armonk, NY, USA). A two-sided p-value <0.05 was considered statistically significant. The characteristics of the study population were summarized as both numbers and percentages for categorical variables and as mean ± SD for continuous variables. Chi-square statistics and independent t-tests were used to evaluate the differences between baseline characteristics of groups or outcomes in this study. We estimated 95% confidence intervals (CIs) using logistic regression for binary outcomes.

Characteristics of ADE-related ED visits
A total of 59,428 cases of ED visits were recorded in three hospitals during the study period (from July 2014 to December 2014). Of these, 2,104 cases (3.5%) were identified as ADErelated ED visits. An estimate of 35.4 (95% CI, 33.8-36.6) per 1,000 ED visits during the study period was recorded. The mean age of patients with ADE-related ER visits was 50.8±24.6 years ( Table 1). Compared with non-ADE-related cases, ADE-related ED visits were more likely to be female (60.6% vs. 53.6%, p<0.001) and older (50.8±24.6 years vs. 37.7±24.4 years, p<0.001). There were more elderly subjects for ADE-related ED visits than for non-ADE causes (30.1% vs. 16.8%, p<0.001). The numbers and proportion of ADE-related ED visit increased with age, with the highest value in subjects aged 70-74 years old (8.5%) (Fig 1). After ED visits, hospitalizations were more frequently required for ADE-related ED visits than for  Table 2 presents the types (mechanisms) and severity of ADE-related ED visits, and comparisons according to age group: children and adolescents (<18 years), adults (18-64 years), and the elderly (�65 years). Regarding types of ADEs, side effects (72.5%) were the most common cause, followed by allergy (13.6%), overdose (7.3%), non-allergic hypersensitivity reaction (3.3%), secondary effect (2.0%), and drug interaction (0.9%). Analysis of the types of ADEs according to age group revealed that overdose was more frequently observed in elderly patients (11.2%) than in adults (5.8%) and children/adolescents (2.2%, p<0.001). However, allergies were more common in children/adolescents (27.1%) than in adults (15.3%) and the elderly (5.2%, p<0.001).

Types and severity of ADEs
The severity of ADEs was assessed and compared among age groups. Severe cases were observed in 20.5% of all cases and were more common in the elderly (30.4%) than in adults (15.8%) and children/adolescents (10.3%, p<0.001). In addition, the rate of hospitalization after ED visits were significantly higher in the elderly (42.8%) than in adults (21.8%) and   (Table 3). In total, 24 ADE-related deaths (1.1%) were noted, mostly in the elderly (n = 16) and adults (n = 8). The mortality rate was higher for the elderly (1.8%) than for adults (0.6%) and children/adolescents (0.0%, p = 0.007).

Preventability of ADEs
Preventable cases comprised 15.5% (n = 327) of total ADEs (Table 4). Preventable cases were more common in the elderly (18.7%) than in adults (15.1%) or children/adolescents (7.4%, p<0.001). Regarding the criteria for determination of preventability, inappropriate dose, route, or frequency of administration was the most common factor (48.3%), followed by poor compliance (28.1%), inappropriate for clinical condition (9.8%), history of allergies or hypersensitivity (8.9%), and drug interactions (8.6%). Moreover, the criteria for preventability varied significantly, depending on the age group. Inappropriate dose, route, or frequency was the most frequent cause for preventability in all age groups. Poor compliance was relatively common in adults, and a history of allergies or hypersensitivity was less common in the elderly population.

Discussion
In this multicenter retrospective observational study, we evaluated the prevalence and characteristics of ADEs leading to ED visits by analyzing data from EMRs and the NEDIS database in three university hospitals in Korea. We observed that ADE-related ED visits comprised 3.5% of total ED visits. Subjects with ADE-related ED visits were more likely to be female and older. Side effects were the most common cause of ADE among all age groups; however, overdose was more frequent in the elderly, and allergies or hypersensitivity reactions were more common in children/adolescents. Serious ADEs occurred predominantly in the elderly population. Moreover, preventable cases were more common in the elderly due to inappropriate dose, route, or frequent administration. Causative drugs of ADE differed substantially according to age group. We believe that the strength of this study is that it analyzed many cases of ED visits and provided critical insight into the features of ADE by comparing among age groups.
To date, this is the first pharmacoepidemiologic study to evaluate the prevalence and characteristics of ADE-related ED visits in Korea. We retrospectively reviewed the medical records of all participants who were visited the ED during the study periods. ADE-related ED visits comprised of 3.5% of the total ED visits and were estimated to constitute 35  existence of specific diagnostic codes indicating ADEs, which ranged from Y44 to Y45 in EMRs [16]. They reported that ADE-related ED visits only comprised 0.22% of total ED visits, which is a substantially lower percentage than that observed in our study. The low prevalence of ADE-related ED visits in Lee's study might become from screening ADEs with diagnostic codes. Hohl et al. reported that ADE-related ED visits were underreported in EMRs, and less than 10% of ADE-related ED visits documented the ICD-10 codes indicating ADEs in medical records [17]. The prevalence of ADE-related ED visits observed in our study were more comparable to the results of previous studies in other countries with similar study designs such as definition, inclusion, and/or exclusion criteria of ADE [6][7][8][9]. Compared to ED visits with non-ADE causes, ADE-related ED visits required hospitalization more frequently. Despite of limitation from retrospective design, we conducted a multi-center and multi-disciplinary study with trained nurses, pharmacists, allergy specialists as well as ED physicians. We also used the comprehensive classification system and causality assessment tool. We retrospectively reviewed the medical records of all patients who visited ED during the study period and, if needed, also reviewed the medical records before and after the ED visits. These well-defined systematic approaches may give us that our findings will reflect the reality of ED visits with ADE better. The findings from this study confirmed that ADEs are more common and serious in elderly individuals, as reported previously [18][19][20][21][22]. Compared to children and adults, more elderly patients with ED visits due to ADEs required hospitalization. The reasons for which the elderly population is more prone to the development of ADEs, and serious outcomes are unclear yet. Elderly people are having multiple comorbidities and are taking multiple medications simultaneously [23,24]. The polypharmacy in the elderly was very high at 83.5% in Korea [25] and 81% in Taiwan [26]. In the western, polypharmacy in the elderly was 39.7% in the U.S. [8] and 33% in Finland [27], which was relatively lower than that in the East, but it is an also important medical and socioeconomic issue. Additionally, physiologic changes and altered drug metabolism in old age may expose elderly individuals to an increased risk of ADEs [28]. Our study revealed that ADE-related ED visits were significantly higher in patients with comorbidities such as diabetes, chronic kidney disease, or chronic liver disease, suggesting polypharmacy in the elderly. ADEs such as side effects or overdose more commonly occurred in the elderly. Among them, preventable ADEs such as 'inappropriate dose, route or frequency of administration' or drug interaction were more frequent in the elderly. Therefore, it can be postulated that combined interactions of polypharmacy and frailty physiologic changes might pose the elderly prone to ADE-related ED visits.
A notable finding of this study is that approximately one of seven ADEs (15.5%) were preventable. Antithrombotic agents (e.g., warfarin, clopidogrel, and aspirin), drugs used in diabetes (e.g., insulin and oral hypoglycemic agents), and antineoplastic agents were common drugs in preventable ADE related ED visits. In the elderly, 'inappropriate dose, route or frequency of administration' or drug interaction were frequent compared to that of young or adults. Diabetic drugs and antithrombotic drugs were the most common causative drugs in elderly subjects. These findings were consistent with other studies conducted in the U.S [8], Canada [29,30], and Italy [31,32]. The MEREAFaPS study group also reported that antiplatelet agents, anticoagulants, and antidiabetics were common causes of ADE-related ED visits in Italy. It means that drugs for chronic medical conditions are the main causes of ADE-related ED visits and a considerable portion of these are preventable. Therefore, coordinated efforts to develop the strategies for managing common preventable ADEs in the elderly should be needed [33].
The proportion of ADE-related ED visits was also higher in the female gender. Differences in the pattern of drug use might be a factor for the gender difference, but female predominance persisted after adjusting the pattern of drug use [22]. The causes of this finding were unclear yet, but genetic predisposition [34], differences in metabolizing capacity of cytochrome enzymes might be related to the gender predisposition of ADR [35]. The female dominance of ADE from neurologic or psychiatric drugs and diuretics was also observed in both our and other studies [36][37][38]. In addition, male predominance of ADE from antineoplastic agents and antithrombotic agents was also observed in both our and other studies [21,22]. Therefore, this discrepancy of ADE-related ED visits rendered tailored medication prescription and instruction according to gender.
Pharmacovigilance studies based on ED visits are useful to monitor both acute and serious ADEs occurring in the community. Since most drugs are consumed outside hospitals, epidemiologic studies on ADEs in hospitalized patients have limited value for evaluating various adverse reactions in real life. Thus, ADE-related ED visits are a crucial indicator for estimating the health issues and consequent economic burden of ADEs. In the US, a nationwide database has been generated to estimate and monitor adverse drug reactions and prospectively collect data on ADE-related ED visits. Since 2002, the Food and Drug Administration, the Center for Disease Control, and CPSC have cooperated to establish the National Electronic Injury Surveillance System (NEISS)-Cooperative Adverse Drug Event Surveillance (CADES), a system for monitoring harmful drug cases [39]. By using this nationwide registry, ADE-related ED visits are actively monitored [33,[40][41][42]. We propose that modification of the NEDIS system to incorporate data on ED visits due to ADEs is warranted, as this will enable continuous and comprehensive monitoring of ADEs in a nationwide approach. The employment of a nationwide pharmacovigilance system for ADE-related ED visits will enable a rapid and effective assessment of information on drug safety and adverse effects.
This study had several limitations. First, given that we retrospectively reviewed the medical records of subjects with ED visits, there was limited information regarding clinical presentation, previous history of drug hypersensitivity, and medications used outside the hospital. Some cases might not have been recorded in the EMR despite the apparent ADE-related ED visits. It is difficult to distinguish retrospectively the ADEs from the worsening of the symptoms and signs of the underlying disease. Therefore, causality and causative drugs were occasionally challenging to determine. To overcome this lack of information, we utilized every database source available, including EMRs of the ED, outpatient department, and hospitalization; the NEDIS; and the clinical data warehouse from each hospital. Second, the results of the multicenter retrospective study may be affected by the different systems in each hospital and discrepancies between researchers. To minimize the heterogeneity of the participating institutions, we used the same database of ED visits (NEDIS). Further, the review process and assessment of major outcomes were based on standardized study protocols and consistent definitions. Third, we analyzed ADE cases visiting the ED at only three university hospitals. Thus, the findings of this study may not represent the overall nationwide features of ADEs. It is possible that subjects with more serious ADEs visited or were transferred to the ED at university hospitals from secondary hospitals or clinics. To assess the nationwide prevalence and features of ADEs, it will be necessary to analyze data from the sentinel centers from each region of the nation.

Conclusion
The increase in drug exposure has led to a rapid increase in the occurrence of adverse drug events (ADEs). Although ADE-related ED visits are a critical issue related to medication safety, the incidence, and epidemiologic characteristics of ADEs leading to ED visits have not been sufficiently studied. To date, this is the first pharmacovigilance study to evaluate ADE-related ED visits, and it is also meaningful that it has been carried out as a multi-center and multi-disciplinary approach. The prevalence of ADE in ED visits was common in Korea and higher in older adults and females. Many cases of ADEs were preventable and predictable. A further prospective study is needed to evaluate the nationwide burden of ADE leading to ED visits.
Supporting information S1