{'fraction_non_alphanumeric': 0.02205198600717354, 'fraction_numerical': 0.00438382854359474, 'mean_word_length': 5.498992805755396, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Consensus on Language for Advance Informed Consent in Health Care–Associated Pneumonia Clinical Trials Using a Delphi Process

Key Points Question What information do key stakeholders want in informed consent forms for noninferiority clinical trials on hospital-acquired and/or ventilator-associated bacterial pneumonia, and how should such information be described? Findings In this Delphi study of 52 key stakeholders (patients at risk of pneumonia, caregivers, representatives of institutional review boards, investigators, and study coordinators), consensus was reached on how to describe reassurances on patient health and treatment, a rationale for advance consent and early enrollment, and noninferiority. Meaning Results of this study suggest that inclusion of information on these concepts in informed consent forms may help potential participants make informed decisions about participating in noninferiority trials of health care–associated pneumonia treatment.


Introduction
In response to difficulties in recruiting patients for clinical trials in hospital-acquired and/or ventilatorassociated bacterial pneumonia (HABP/VABP), [1][2][3][4][5] the Clinical Trials Transformation Initiative (CTTI), a public-private partnership cofounded by the US Food and Drug Administration (FDA) and Duke University, Durham, North Carolina, developed a novel early enrollment strategy as part of its portfolio of projects in antibacterial drug development. 6 With this strategy, patients at risk for hospital-acquired pneumonia consent to monitoring by study staff in advance of developing pneumonia. If these patients subsequently develop HABP/VABP, they are randomly assigned to receive an investigational or comparator antibiotic. Although obtaining advance consent for treatment of potential complications that require immediate care is feasible, 7 enrolling patients early into clinical trials is uncommon. Knowledge about appropriate information to include in advance consent forms for pneumonia treatment trials remains to be determined, particularly for noninferiority trials. 8 Previous CTTI research suggested that key stakeholders find an early enrollment strategy using advance consent in pneumonia antibiotic trials to be acceptable. 9 As a component of that research, CTTI also engaged these stakeholders to identify, describe, and reach consensus on essential concepts to be included in an advance consent form for an early-enrollment, noninferiority HABP/ VABP clinical trial. We describe here the development of the proposed text for the advance consent form, together with supporting information.

Methods
We engaged 5 stakeholder groups in the research: patients at risk for pneumonia, caregivers of patients at risk for pneumonia, investigators, study coordinators, and representatives of institutional review boards (IRBs). Information on stakeholder recruitment and selection has been reported. 9 We used a Delphi consensus process 10 to identify information to be included in an advance consent form and how to describe that information. We explained to stakeholders that hospitalized patients who were identified to be at risk for pneumonia would be asked to consent to being monitored by study staff to determine if they develop HABP/VABP, and randomly assigned to receive 1 of 2 antibiotics if they develop HABP/VABP. The antibiotics were imipenem, an FDA-approved antibiotic for lower respiratory tract infection, and meropenem, an antibiotic approved for other serious infections and commonly used off-label for treating pneumonia. This study followed the Standards for Reporting Qualitative Research (SRQR) reporting guideline for qualitative studies.
As the first step in the Delphi process, we conducted qualitative, semistructured telephone interviews. The interviewer provided stakeholders with an overview of the proposed noninferiority trial and early enrollment strategy. The interviewer also described the study antibiotics and explained to patients and caregivers that the study hypothesis was that meropenem may not work as effectively as imipenem in the treatment of pneumonia but may have fewer adverse effects.
(eAppendix 1 in the Supplement includes the study overview provided to all stakeholders.) Table 1 lists the initial and follow-up topics explored with each stakeholder group. The initial questions asked stakeholders to describe essential information that should be provided in an advance consent form and how to explain that information. The follow-up probes solicited stakeholders' suggestions on how to explain certain topics, if not initially mentioned. We included the follow-up topics because (1) we expected the need to describe these areas in the advance consent form and wanted stakeholder feedback on how best to explain them, and (2) research has shown that the purpose of noninferiority trials (one of the probed topics) is typically not described in consent documents. 8 We analyzed the qualitative data using applied thematic analysis. 11 We first identified the most common essential concepts that stakeholders mentioned and how to describe them before the interviewer probing. Next, we thematically combined those responses with the probed responses on how to explain essential concepts to identify the most common suggestions for describing the concepts. We grouped these suggestions into larger consent categories, focusing on categories that go beyond the Common Rule 12 elements of informed consent (eg, risks) and that the study team believed should be explained in an advance consent form (ie, noninferiority trials). The study team then drafted consent form text for these categories, taking into consideration stakeholders'

JAMA Network Open | Ethics
suggestions for explaining essential information.
We then conducted 2 rounds of online surveys with open-ended and closed-ended questions to assess the importance of the consent text and to reach consensus on the advance consent language. All stakeholders who participated in the interviews were invited to participate in the first survey. During the first survey, we summarized the qualitative descriptive findings from the interviews, then presented the draft consent form text for explaining each category. We informed stakeholders that our goal was to include language in the advance consent form that would be easy for patients to understand and help patients make an informed decision about participating in a noninferiority trial that uses an early enrollment strategy. We also told stakeholders that we wanted to provide concise explanations. Stakeholders reviewed the descriptive findings from the interviews and classified each statement (or group of statements) in the draft consent form text as (1) "important: remain as is," (2) "important: but changes needed," or (3) "unimportant: remove." We asked stakeholders to suggest a revision if they chose response option 2 and provide a rationale if they chose option 3.
We analyzed the open-ended responses to the first survey by grouping and summarizing similar answers; we used response frequencies to assess the closed-ended responses. We used stakeholder feedback from the first survey to modify the draft consent text, and we prepared the second survey to obtain stakeholder feedback on the modified text. Only stakeholders who participated in the first survey were invited to participate in the second survey. During the second survey, stakeholders reviewed the descriptive findings from the first survey and provided feedback on the revised consent form text. They classified each statement in the draft text (or group of statements) as (1) "important: should remain" or (2) "unimportant: remove." Stakeholders were asked to give a rationale for the removal of sentences; they could also provide overall comments for each statement or group of statements. We then reviewed the responses, using the same methods described previously, and finalized the consent text.

Three Essential Concepts
We identified 3 concepts that stakeholders stated were essential to describe in an advance consent form: (1) reassurances about patient health and treatment, (2) reasons for enrolling early, and (3) information about study antibiotics. We placed stakeholders' suggestions about how to explain these concepts into 3 further categories for inclusion in an advance consent form: (1) reassurances on patient health and treatment, including information about study antibiotics, (2) a rationale for advance consent and early enrollment, and (3) an explanation of noninferiority. We included an explanation of noninferiority as the third category because of the importance the study team placed on explaining the concept of noninferiority to potential participants. Stakeholders' narratives supporting these categories, including their recommendations for explaining them, are described in the next 3 sections and summarized in Table 3.

Reassurances on Patient Health and Treatment
Several stakeholders said the differences between clinical care and research should be explained.
Stakeholders emphasized that patients should be told their health is the top priority and their care will not be compromised if they choose to participate in the trial. Several also emphasized the importance of explaining to patients that, should they choose to take a study antibiotic, study staff will closely monitor their health to determine how well the study antibiotic is working and evaluate when they would be switched to an alternative, effective treatment for pneumonia, if the study antibiotic did not appear to be working (concept 1, Table 4).
Many stakeholders suggested patients should be informed that the study antibiotics are routinely used for treating pneumonia, though one is not FDA-approved for pneumonia. Several also suggested the advance consent form should state that if patients develop pneumonia, they will receive treatment regardless of whether they join the trial, and the treatment could be one of the study antibiotics or another antibiotic (that is already used as standard of care), and patients will not be given a study drug if they are not diagnosed with pneumonia.

Rationale for Advance Consent and Early Enrollment
Almost all stakeholders emphasized that patients should be informed that they were approached about trial participation because they are at high risk for pneumonia. Numerous stakeholders said that informing patients that they may not develop pneumonia, even though they were identified as being at risk and were invited to participate in an early enrollment clinical trial on pneumonia, was an essential concept to include. They also focused their narratives on describing that the consent form should emphasize that patients do not currently have pneumonia but that they could get it and describe the specific factors that place patients at risk for pneumonia.
Several stakeholders believed patients and their caregivers should be informed that early enrollment allows them to "make a plan" and "be proactive" in their research decision making, and provides an opportunity to make a decision about research participation before becoming sick. Some stakeholders said early enrollment allows patients to start study treatment earlier in the context of research than traditional consent because all decisions about research participation are made previously by the patient (concept 2, Table 4).

Explanation of Noninferiority
Most IRB representatives, investigators, and study coordinators acknowledged the difficulty of explaining noninferiority trials, and some described noninferiority trials incorrectly themselves.
These stakeholders expressed concern about whether patients and caregivers would understand the concept of noninferiority. For this reason, several said the advance consent form should keep it simple in explaining the concept of noninferiority. Focus can be placed on describing the differences between the 2 study antibiotics and explaining noninferiority broadly when describing how the study antibiotics will be compared. They cautioned against including detailed design explanations, and some advised against using the word "worse" because that word could cause unwarranted concern about efficacy and the purpose of the trial.
Patients and caregivers said the explanation of how the study antibiotics are compared should focus on describing potential differences in efficacy, using words such as "about the same" or "better," and the potential for the comparison to reveal important differences in adverse effects (concept 3, Table 4).
Several narratives demonstrated the struggle that some investigators, study coordinators, and IRB representatives had in finding an accurate description of a noninferiority hypothesis while balancing being true to the noninferiority hypothesis, avoiding unnecessary concern among potential study participants who believe they will receive an inferior drug, and acknowledging that the study antibiotics are currently used to treat pneumonia. For some, and because of misunderstanding by

Explanation of noninferiority
Limited understanding "I don't think most of the patients will understand the complexity of a noninferiority trial… There's too much information. It just gets very complex for them to understand." -IRB chair "In all fairness to the patient, a lot of doctors don't understand what a noninferiority trial is… You're trying to explain a very complicated concept, and whether or not, and how you would explain, would vary greatly between the patients." -Investigator How to explain "I'm not sure it's necessary to share the details of 'we're really trying to see if one is worse than the other'… We use the drugs in practice right now, and we think they're essentially noninferior. We think they're pretty similar." -Investigator "[The consent form can state:] We want to run the clinical trial, because we want to find out the difference between A and B…is it better, are the side effects less in A than they are in B? Do they have different ones that A that B doesn't have, that would make it easier?" -Female patient, 50s Abbreviation: IRB, institutional review board.
others, this struggle led to alternative suggestions to explain how the study drugs will be compared, such as "better," "equivalent or similar," "work equally well," or "are similar within a certain range." First Online Survey eAppendix 2 in the Supplement includes frequency data from the first online survey. Most stakeholders rated almost all statements (n = 39) as "important, remain as is" or "important, but changes needed." For statements rated as "important, but changes needed," stakeholders suggested alternative wording for some statements and sought clarity for other statements. Some stakeholders suggested that certain sentences be removed from the consent text. For example, 12 stakeholders suggested removing the following statement about noninferiority trials: "Before this trial started, researchers determined how much less well the new drug can work compared to the existing drug and still be acceptable" Some stakeholders commented that information about noninferiority will be confusing, could scare participants, and is too detailed for a consent form. As a result of all stakeholders' suggestions, we modified many of the sentences and removed some sentences.
eAppendix 3 in the Supplement shows the revised text. Statements describing noninferiority continued to be more problematic than other categories: the percentage of statements that reached at least 90% consensus for "important, should remain" was 91% for rationale for advance consent and early enrollment, 100% for reassurances, and 74% for noninferiority. eAppendix 3 in the Supplement shows the revised final consent text.

Discussion
The previous CTTI study reported that an early enrollment strategy using advance consent is an acceptable approach to patients and other key stakeholders in clinical research. 9 However, the approach places novel demands on the informed consent process, particularly for a noninferiority HABP/VABP clinical trial evaluating 2 commonly prescribed antibiotics. To address this challenge, we interviewed 52 key stakeholders to identify information they would include in consent forms given this context and how to describe this information. As may be expected, stakeholders focused on providing information about the study antibiotics and the rationale for early enrollment.
Stakeholders' comments about reassuring patients that their clinical care takes precedence over research, while an overall research ethics principle, highlights the importance of explaining in ways meaningful to potential participants how decisions about patient care are made when research is embedded in standard care settings. Consent information must also emphasize that immediate treatment will be provided regardless of research participation, so that patients will not believe that participating in research is advantageous over standard care. While such reassurances are not unique to early enrollment, they are especially important when discussing a potential serious complication such as HABP/VABP. Thus, it is imperative to reassure patients that their care will not be compromised for the purposes of facilitating research. Such information is typically not described in detail in consent forms using suggestions from key stakeholders.
Patients who are approached about trial participation before they develop the condition of interest, in this case HABP/VABP, are expected to be at higher risk for the condition, because early enrollment works best when it focuses on patients most likely to become eligible. However, informing patients about their increased risk poses a dilemma. Patients may appreciate learning their risk and the steps being taken to reduce it, but they may also experience greater anxiety from learning about a complication they had not previously considered. For this reason, researchers using advance consent, particularly for serious conditions, may wish to identify mechanisms to help patients cope with any anxiety they experience after learning of their increased risk.

JAMA Network Open | Ethics
A 2017 study reported that most clinical trials of infectious disease therapeutics are noninferiority trials, 8 which allow for some loss of efficacy in the new intervention compared to older, effective standards of care in trade-off for another benefit, such as decreased adverse effects or cost. 13 While we refer to studies that contain noninferiority hypotheses as "noninferiority trials," the inherent trade-off means that trials with noninferiority hypotheses should also have superiority hypotheses associated with proposed non-efficacy benefits, such as decreases in adverse effects.
Hypothesized superiority of non-efficacy benefits is necessary to justify the choice of the noninferiority hypothesis and to explain the proposed trade-off between potential lesser efficacy and non-efficacy benefits. In our example, we posed that meropenem might have fewer adverse events than imipenem in trade-off for a potential loss of effect.
Researchers have described the need for different informed consent language for noninferiority trials. 14 Yet, multiple interpretations of the basic principles of noninferiority remain, 15 as suggested in our results. While there were concerns by stakeholders that patients might not understand the noninferiority concept, some investigators, study coordinators, and IRB members also had their own misconceptions. Others have documented a lack of varied understandings of noninferiority trials, including the trade-offs. 16 We also found that whether and how to explain a noninferiority trial in consent text eludes easy consensus. Ultimately, this confusion and concern might reflect that the noninferiority design is not an intuitive statistical or clinical concept, whereas superiority designs are likely more readily understandable or more familiar. Nevertheless, inscrutability cannot be the rationale for not explaining important trial design aspects to potential participants, as explaining the study purpose is required by ethics guidelines (45 CFR 46.116). 12 Consent text should emphasize the potential trade-offs between antibiotic efficacy and other benefits, acknowledging that a trial result of lesser efficacy may be considered a successful outcome. Others are engaging patients in the selection of noninferiority margins and the inherent trade-offs in these trials. 17

Strengths and Limitations
The strengths of our study include input from diverse stakeholders and a use of an iterative process for soliciting and incorporating their feedback. Other researchers have reported the need for patient input in designing clinical trials. 17 Although the proposed consent language was developed for a HABP/VABP trial, the language can be adapted for other noninferiority trials and trials using an early enrollment strategy.
Our study also has limitations. First, we used purposive sampling to select patients similar to those enrolled in HABP/VABP trials, and their opinions may not be the same as other patient populations, particularly given that many of these stakeholders had high levels of education. Second, we did not evaluate the final proposed consent language after the second online survey. Further research can assess the utility of this language with a larger number of stakeholders, including how best to modify the language for non-US populations. We do not intend, however, for the proposed language to be used verbatim in all situations. Rather, we hope the language will inform researchers' decisions about the kinds of information to include in consent documents and provide sample text that is acceptable to many stakeholders. Third, we were guided by stakeholders' statements but made necessarily subjective judgments about what to include and how to phrase the statements.
Fourth, we explained early enrollment and noninferiority (for some stakeholders) at the beginning of the qualitative interview, which may have informed stakeholders' suggestions for topics to include in the consent text. Fifth, consent text for other noninferiority trials will change based on the hypothesized non-efficacy benefits proposed with the new intervention.
Adding language to already lengthy consent forms may be undesirable. However, every sentence in the final consent text was rated as "important, should remain" by most stakeholders. We envision that this sample language will replace some current sections of consent forms while