{'fraction_non_alphanumeric': 0.036200285692805055, 'fraction_numerical': 0.021690098488835425, 'mean_word_length': 5.075131308517927, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Validated Instruments of Quality of Life (QOL) in Patients With Acute Myeloid Leukemia (AML) and Other Cancers

Introduction Acute myeloid leukemia (AML) can negatively impact quality of life (QOL). Few QOL instruments are specific to and have been validated in AML. This review aims to identify QOL instruments that have been validated in patients with AML and other cancers and summarize their psychometric properties reported in published literature. A literature review search was performed using PubMed and OVID (Biosis, Embase, MEDLINE) databases through June 25, 2020. Search terms included: QOL, health-related QOL, patient-reported outcomes and validity, reliability, validated, tools, instruments, test-retest, and leukemia myeloid acute, leukemia, myeloid, acute, acute myeloid leukemia. Articles were included if they focused on cancer and reported psychometric properties that could be extracted. Abstracts and their references were reviewed for inclusion. Results Twelve evaluating ten instruments were included. Functional Assessment of Cancer Therapy Leukemia (FACT-Leu) showed internal consistency (IC) of α = 0.86 to >0.9, correlation with EQ-5D-3L of r > 0.50, correlation with European Organisation for Research and Treatment of Cancer (EORTC) QLQ-Leu of ρ = 0.29–0.63, test-retest reliability of κ = 0.861. FACT-F showed correlations with EORTC QLQ-C30 of r = 0.40–0.83. Hematological Malignancy Patient-Reported Outcome (HM-PRO) showed intraclass correlation coefficient (ICC) of 0.94–0.98. EORTC-8D and EQ-5D-3L showed ICC = 0.595, correlations with each other of ρ = 0.137–0.634 and with EORTC QLQ-C30 of r = 0.651–0.917. EORTC QLQ-C30 showed person separation reliability of 0.47 to 0.90 and patient-observer agreement of 0.85. Life Ingredient Profile (LIP) showed IC of α = 0.29–0.77 and test-retest reliability of κ = 0.42–1.0. QOL-E showed correlation with FACT-general of R = 0.71, internal validity of α = 0.7, and test-retest reliability of standardized Cronbach’s α = 0.7–0.92. EORTC QLQ-Leu showed IC of α = 0.6–0.79. The Acute Myeloid Leukemia–Quality of Life (AML-QOL) instrument showed IC of α = 0.72, correlations with EORTC QLQ-30 of magnitudes ρ = 0.59–0.72, and test-retest reliability of ICC = 0.52–0.91. Conclusion Although several QOL instruments have been validated, more research is needed to determine the most clinically useful instruments in patients with AML.


INTRODUCTION
Acute myeloid leukemia (AML) is an aggressive and devastating disease. It is estimated that only up to 27% of patients with AML in the United States survive after 5 years, and some estimates indicate a median survival for elderly patients with AML of 2 months (Menzin et al., 2002;Blum and Bloomfield, 2018). Though AML is a relatively rare cancer that accounts for about 1.2% of all cancers, it is the most prevalent type of acute leukemia in older patients in the United States (Blum and Bloomfield, 2018). In addition to the aggressive nature of the disease, patients often present with debilitating symptoms (such as fatigue, anorexia, fever, bone pain, and abnormal bleeding) that can greatly affect their ability to perform activities of daily living (ADLs) and can have a large impact on their quality of life (QOL) (Blum and Bloomfield, 2018).
AML treatment can follow one of two main pathways: intensive chemotherapy (consisting of induction and consolidation phases) or supportive care . Treatment choices are often patient-specific, especially in elderly patients for whom the benefits compared to the risks of intensive chemotherapy are largely uncertain . Furthermore, chemotherapy regimens for AML are often associated with serious treatment-related toxicities that can negatively affect QOL (Kantarjian et al., 2006). Because of this, measuring QOL in patients with AML can provide insights into aspects of their health that are adversely affected by the disease and its treatment. These measurements can help healthcare professionals make informed decisions regarding the treatment of AML.
QOL is often measured through questionnaires completed by the patients themselves (Health-related quality of life (HRQOL), 2018). Some QOL instruments are developed specifically to be used in one disease state or a group of related disease states, while others are generic instruments intended to be used in a variety of patient populations and disease states. There are few QOL instruments that have been developed for patients with hematologic disorders and fewer that have been developed specifically for patients with leukemia. However, there are many generic QOL instruments developed for general use that have been used in patients with AML in the past. Due partly to the multitude of instruments available, the appropriate QOL instruments to use in AML have not been determined. Some argue in favor of the use of generic instruments because they allow for standardization and comparability among different disease states. Others believe disease-specific instruments increase the relevance of the instrument to aspects of QOL that are differentially affected by different disease states (Lorgelly et al., 2017).
Whether using a generic or specific instrument, it is first necessary to evaluate the instrument's validity in the population of interest to ensure that valuable information can be gained from its use. Validation of QOL instruments involves various methods to determine the extent to which the instrument measures what it purports to measure and can respond to differences in QOL over a period of change. The reliability of instruments is often measured to determine the instrument's ability to produce stable results over a period of time during which no changes have occurred (Measurement properties: validity, reliability, and responsiveness, 2018). This literature review aims to identify QOL instruments that have been validated and summarize their psychometric properties relating to their validity and reliability in published literature.
A literature search was performed using PubMed and OVID (Biosis, Embase, and MEDLINE) to identify articles to include in this review. All databases were searched for relevant articles published through June 25, 2020. The search terms included QOL, health-related QOL, life quality, patient-reported outcomes and validity, reliability, validated, tools, instruments, test-retest, measurement, patient health questionnaire, questionnaire assessment and leukemia myeloid acute, leukemia, myeloid, acute, acute myeloid leukemia, acute myelogenous leukemia, AML. Duplicates were removed from the search results and references of included articles were reviewed to identify additional articles for inclusion. Two investigators (MS and ME) independently completed two levels of screening of articles found in the literature search. First, the titles were reviewed for relevance, and then abstracts and full texts of selected relevant articles were reviewed for inclusion. Discrepancies in the selection of abstracts were addressed through consensus. Articles were excluded if they focused on disease states other than cancer or were focused on stem cell transplants, other types of transplants, and/or other surgical procedures, or they did not report reliability and/or validity information of a QOL instrument. Articles that provided psychometric properties of validity and/or reliability in patients with cancer were included in the review.

Article Identification and Selection
From a total of 346 articles found through the literature search and other sources (e.g. review of references of full articles), 92 abstracts and full texts were selected for review. Of these, 80 were excluded after abstract and full text review. The reasons for exclusion were the following: the lack of validated instrument (N = 54) or focus on: treatment effectiveness (N = 6), organ transplantation (N = 10), predictors of outcomes (N = 2), and burden of disease (N = 8). The total number of full text articles included in this review is 12 (Figure 1). The article selection process is documented in Figure 1, and the properties of the included articles are described in Table 1.

Validated Instruments
There were ten QOL instruments with reported validity and/or reliability properties: Acute Myeloid Leukemia -Quality of Life   Therapy fatigue subscale (FACT-F) and leukemia (FACT-Leu). Of these, one is a generic QOL instrument, three are specific to hematologic disorders, three are specific to cancer, and three are specific to leukemia. A brief description of the specificity of the QOL instruments and the disease states the instruments were evaluated in are provided in Table 2.

General Overview of Validity and Reliability Measures
There was variation in methods used to measure validity and reliability. Measures to assess validity included convergent validity and agreement between trained observers and patients. Convergent validity measures the correlation between two instruments that are meant to measure the same construct. Agreement measures the correlation between an observer's response to items in an instrument and the patient's responses to items in the instrument. Measures to assess reliability included internal consistency, test-retest reliability, and intraclass correlation coefficient. Internal consistency measures the correlation of items for the same construct within an instrument. Test-retest reliability measures the correlation of a patient's responses to items in an instrument at two different time points during which nothing significant should have changed to alter the patient's responses. Intraclass correlation coefficient measures the correlation between items or responses within a group. Psychometric properties of validity and reliability for the instruments evaluated are presented in Table 3 and discussed further in the next sections. The Consensus-Based Standards for the Selection of Health Status Measurement Instruments (COSMIN) checklist criteria were applied to all articles to evaluate the methodological quality of the studies (Mokkink et al., 2010). These results are presented in Table 4.
Due to the variability in the methods used across studies to evaluate QOL instruments, it was not feasible to directly compare the psychometric properties of all instruments included in the review.
In addition to quantitative results, many of the articles also qualitatively evaluated characteristics of the QOL instruments. These qualitative results are reported in the following sections when applicable.

AML-QOL
Buckley and colleagues (2020) developed and validated the AML-QOL, an AML-specific QOL instrument. They did this in several cohorts of patients: cohorts of three to six patients with AML or aggressive myeloid neoplasms (development), 202 patients with AML or high risk myeloid neoplasms (to evaluate internal consistency), and 50 patients with AML or high risk myeloid neoplasms (to evaluate test-retest reliability, convergent/divergent validity, and sensitivity). Patients were evaluated at five points in time: prior to treatment (T1), days 8 to 18 after treatment initiation (T2), 1 to 4 days after T2 (T3), at the end of the cycle (T4), and after all planned chemotherapy (T5). Reliability and validity results are reported in Table 3. During the development phase, patients and healthcare providers reported the instrument was "comprehensible, pertinent, and thorough." Eleven items (out of 38) were removed after factor analysis with 202 patients. Furthermore, a higher/worse Eastern Cooperative Oncology Group (ECOG) performance status was reported to be associated with significantly lower summary scores on AML-QOL. AML-QOL was reportedly sensitive to change; patients who perceived a benefit showed higher QOL scores while those who perceived a worsening had lower QOL scores.

FACT-Leu and FACT-F
Cella and colleagues (2012) evaluated FACT-Leu, a QOL instrument developed from the FACT-General instrument. The authors evaluated FACT-Leu's face, content, and convergent validity and reliability in 79 patients with leukemia at three points in time (baseline, 3-7 days later, 8-12 weeks later). Reliability and select validity results are reported in Table 3. Additionally, patients reported that the FACT-Leu was "relevant," "comprehensive," and "easy to understand." Peipert and colleagues (2020) evaluated the validity, internal consistency, and responsiveness to change of the FACT-Leu instrument in 317 clinical trial participants with AML. Validity and reliability results are reported in Table 3. Additionally, all but two scales on FACT-Leu were reported to decrease as ECOG performance status increased/worsened, and all but two scales on FACT-Leu were able to distinguish between baseline ECOG performance status groups. The FACT-Leu was reported to exhibit responsiveness to change; as shown by correlations between change scores for FACT-Leu and EQ-5D scales.
Alibhai and colleagues (2007)    a≥0.70 Internal consistency (FACT-Leu total, FACT-Leu TOI, FACT-G) a≥0.90 Correlation with EQ-5D-5L (except SWB) r > 0.50 Correlation between FACT-Leu change scores and EQ-5D scale change scores r > 0.   Table 3. The authors reported that fatigue scores improved slightly over time in patients receiving or not receiving intensive chemotherapy and that patients who died or withdrew from the study tended to have worse fatigue scores than those who remained in the study. Fatigue was found to be inversely correlated to global health, major domains of QOL, and ADLs. Because of the relatively short follow-up, the authors indicated that it was impossible to differentiate fatigue and QOL results due to intensive chemotherapy or the cancer itself.

HM-PRO
Goswami and colleagues (2019) evaluated electronic and paper versions of the HM-PRO instrument in 193 patients with hematologic malignancies (29 with AML specifically) in the United Kingdom. Patients completed the paper and electronic versions of the instrument on the same day. Correlations for the electronic and paper instruments are presented in Table 3.
Patients reported that HM-PRO was easily readable, they could answer questions spontaneously, and they thought the electronic version of HM-PRO was easy to follow. The authors additionally reported that it took patients a median of 5 min to complete the paper version and 6.5 min to complete the electronic version of the HM-PRO.

EORTC-8D and EQ-5D-3L
Lorgelly and colleagues (2017) evaluated the EORTC-8D and EQ-5D-3L in 1678 patients with a variety of cancer diagnoses who were enrolled in Cancer 2015. Correlation results between the instruments and EORTC QLQ-C30 are presented in Table 3.
Both EQ-5D-3L and EORTC-8D were reported to be sensitive to the following: sex, admission to hospital, smoking, stage of disease, hospital insurance, expected future follow-up, and Eastern Cooperative Oncology Group performance status score.

EORTC QLQ-C30
Shih and colleagues (2013) evaluated the reliability and construct validity of the EORTC QLQ-C30 with unidimensional and multidimensional Rasch partial credit models in 2295 patients with lung, breast, cervical, liver, or colorectal cancer. Reliability results are presented in Table 3. The authors reported that reliability was higher with a multidimensional partial credit model compared to a unidimensional partial credit model. Additionally, the authors reported a significant difference in deviance between the two models (P < 0.001), a method they used to evaluate the construct validity of the instrument. Groenvold and colleagues (1997) evaluated the patienttrained observer agreement for the EORTC QLQ-C30 questionnaire in 95 patients with gynecologic or breast cancer. Agreement results are presented in Table 3. Disagreements between patients and observers were reported to fall into the following categories: observer found patient's response surprising, patient reported symptoms were due to something else, patient did not understand how to interpret an item or the patient misunderstood an item, or the observer did not know how to respond. Aaronson and colleagues (1993) evaluated the reliability and validity of the EORTC QLQ-C30 questionnaire in nine languages in 305 patients with nonresectable lung cancer who were considered candidates for intensive chemotherapy or radiation. Patients were evaluated at two time points, once after diagnosis before starting treatment and once during treatment. Reliability results are presented in Table 3. Validity was evaluated through correlations between subscales, ability to discriminate between subgroups of patients, and responsiveness to change in health status over time. The instrument did not find differences between pretreatment and on-treatment scores depending on disease stage except for emotional functioning in patients with metastatic disease compared to non-metastatic disease. Repeated-measures analysis of variance (ANOVA) did not find any differences in pretreatment or on-treatment scores on any scale except nausea and vomiting, which showed mean scores of 6 and 20, respectively (p < 0.001). However, when patients were sub-grouped by  performance status, repeated-measures ANOVAs found betweengroup differences over time in physical functioning (P<.001), role functioning (P<.001), fatigue (P<.01), nausea/vomiting (P<.05), and global QOL (P<.01). About 10% of patients reported that they found at least one item on the questionnaire to be confusing or difficult to answer. Stalfelt and Wadman (1993) evaluated the validity of the LIP instrument (comprising LIP 1, LIP 2, and LIP 3) in 35 patients with hematologic malignancies. Reliability and validity results are presented in Table 3. Patients with AML showed lower LIP 2 scores in all areas except side effects and disease symptoms during the induction phase of chemotherapy. Scores on LIP 2 mobility and autonomy items, physical symptoms, mental symptoms, and disease symptoms were reported to be significantly lower in the patients with advanced myeloma compared to the myeloma patient group as a whole, but no quantitative analysis results were provided. Correlations between LIP 3 and LIP 1 and 2 were low, which the authors used to convey divergent validity, as these instruments are meant to measure different aspects of life. No quantitative results were presented other than those included in Table 3. During the study, few items on the LIP questionnaires were reported to require reformulation due to confusion or low response rates, including those about "social contact," "sexuality," and "degree of energy."

QOL-E
Oliva and colleagues (2013) developed and evaluated the validity of the QOL-E in three phases: a development phase, a pilot study phase with 52 patients with myelodysplastic syndromes (MDS), and a third phase evaluating the validity of the instrument in 147 patients with MDS. Validity and reliability results from the second and third phases of the study are presented in Table 3. The development phase identified nine concepts important to patients with MDS that were included in the instrument. During the second phase of the study, 11 items were removed because they did not fit the analysis, or they were incomprehensible or misunderstood by patients. Watson and colleagues (1996) evaluated the validity and reliability of the MRC/EORTC QLQ-LEU in 388 patients with leukemia in long-term complete remission. Patients received, completed, and mailed back one questionnaire each for the study. Reliability results are presented in Table 3. After analysis, the researchers recommended alteration of the item subscales in the instrument due to questionable validity.

DISCUSSION
A total of 12 articles (Aaronson et al., 1993;Stalfelt and Wadman, 1993;Watson et al., 1996;Groenvold et al., 1997;Cella et al., 2012;Oliva et al., 2013;Shih et al., 2013;Lorgelly et al., 2017;Goswami et al., 2019) presenting psychometric properties of validity and/or reliability for ten QOL instruments are presented in this review. Of these, eight articles evaluated seven instruments (AML-QOL, FACT-F, FACT-Leu, EORTC QLQ-Leu, LIP, HM-PRO, and QOL-E) in patients with AML or disease states related to and inclusive of AML. Of the remaining articles, one evaluated two instruments (EQ-5D-3L and EORTC-8D) in patients with any cancer diagnosis, with no indication of their validity in the AML subpopulation. The remaining three articles evaluated the EORTC QLQ-C30 in several patient populations (including those with lung, cervical, breast, liver, and colorectal cancer) but lack evidence in AML.
Articles that evaluated instruments in more specific populations tended to have smaller sample sizes, with a median of 113 patients (range, 35-388) (Stalfelt and Wadman, 1993;Watson et al., 1996;Cella et al., 2012;Oliva et al., 2013;Goswami et al., 2019;Buckley et al., 2020;Peipert et al., 2020). Articles that evaluated instruments in broader patient populations tended to have larger sample sizes, with a median of 991.5 patients (range, 95-2,295) (Aaronson et al., 1993;Groenvold et al., 1997;Shih et al., 2013;Lorgelly et al., 2017). This indicates a trade-off between evaluating instruments in the disease of interest versus evaluating instruments in a large patient sample. This limitation in published literature and lack of replicated results available restricts the ability to evaluate the true validity and appropriateness of the instruments in patients with AML. In determining what QOL instrument to use in patients with AML, the need for more robust validity information must be weighed against the need for validity information in the specific population of interest.
Validity and reliability results varied both within a single instrument and between different instruments included in this review. In general, correlation coefficients in the range of 0.3 to 0.5 can be considered to be low, those in the range of 0.5 to 0.7 can be considered to be moderate, and those in the range of 0.7 to 1.0 can be considered to be high to very high (Mukaka, 2012). Many instruments included in this review showed at least moderate values for validity and reliability outcomes. Exceptions to this were largely due to results with wide ranges that encompassed low to moderate or high values. These included FACT-Leu's correlation with EORTC QLQ-Leu subscales (range of r = 0.36-0.6), correlations between EORTC-8D and EQ-5D-3L (range of r = 0.137-0.634), testretest reliability for LIP 2 and LIP 3 (range of k = 0.42-1.0), baseline FACT-F correlations with EORTC QLQ-C30 global QOL, physical, role, emotional, social, and cognitive function (range of r t0 = 0.4-0.73), and EORTC QLQ-C30 reliability (unidimensional partial credit model; person separation reliability range of PSR = 0.47-0.891).
QOL instruments can be validated in many ways, some of which were not adequately addressed in this review. One important example of this is sensitivity to change. In other words, the ability of the instrument to detect changes in QOL depending on the disease course and progression of the disease at different time points in the patient's life (e.g., QOL in remission vs. QOL in relapse). Only two instruments were quantitatively evaluated for sensitivity to change: EORTC QLQ-C30 and FACT-Leu. EORTC QLQ-C30 was quantitatively evaluated for sensitivity to change with variable results (Stalfelt and Wadman, 1993). Changes in scores for FACT-Leu were correlated to changes in scores for EQ-5D scales, and resulted in moderate correlations (Peipert et al., 2020). Three articles offered qualitative evidence of sensitivity to change for EORTC-8D, EQ-5D-3L, and LIP [6,9,14]. However, sensitivity to change has been qualitatively evaluated further in patients with AML for two instruments discussed in this review, EORTC QLQ-C30 and HM-PRO. These articles were not specifically included in the review because no psychometric properties were reported. In one article, patients who later reported a QOL similar to their baseline QOL did not show changes in HM-PRO scores. However, patients who later reported a QOL that was better than their baseline QOL showed significant improvement on HM-PRO scores (Schumacher et al., 1998). In two other articles, patients' EORTC QLQ-C30 scores were found to be related to treatment, phase of the disease, and performance status. However, due to a lack of detailed information regarding sensitivity to change, the importance of this type of validity remains unclear Goswami et al., 2018).
Accurately measuring QOL in patients with AML can assist healthcare professionals in understanding the overall health state of their patients, which can help tailor health care to individual patient needs. Before QOL instruments can be used effectively, they must be developed and validated to ensure that they accurately measure what they intend to measure and that they can provide useful information about the patient population of interest. This review aimed to understand which QOL instruments have been used and validated in patients with AML or other types of cancer. Although many QOL instruments have been validated, the inconsistency in methods and nature of the research make it infeasible to directly compare these instruments to one another to determine which instruments are appropriate to use in patients with AML.

CONCLUSION
Many QOL instruments, both generic and specific, have been validated in patients with AML or other cancers. However, certain types of validity information are still lacking for many QOL instruments, and the instruments cannot be directly compared to each other. There is a significant gap in literature evaluating the validity and reliability of QOL instruments in patients with AML. This is especially true concerning the instruments' sensitivity to change in a patient's clinical status and disease status. Furthermore, while more recent research has evaluated QOL instruments specifically in patients with AML, their small sample sizes and lack of replicated results makes it difficult to appropriately interpret their findings. More research is required to determine the most responsive and clinically useful instrument for patients with AML, especially in patients who relapse or are refractory or respond to treatment.

AUTHOR CONTRIBUTIONS
MS and ME designed and performed the literature search and evaluated articles for inclusion. MS and MH drafted the manuscript and critically reviewed the final manuscript. AW-F, ZI, NT, AB, and US discussed the draft and critically reviewed the final manuscript.

FUNDING
This work was supported by Daiichi Sankyo, Incorporated.