text:
|Home | About | Journals | Submit | Contact Us | Français
Interventions often involve a sequence of decisions. For example, clinicians frequently adapt the intervention to an individual's outcomes. Altering the intensity and type of intervention over time is crucial for many reasons, such as to obtain improvement if the individual is not responding or to reduce costs and burden when intensive treatment is no longer necessary. Adaptive interventions utilize individual variables (severity, preferences) to adapt the intervention and then dynamically utilize individual outcomes (response to treatment, adherence) to readapt the intervention. The Sequential Multiple Assignment Randomized Trial (SMART)provides high-quality data that can be used to construct adaptive interventions. We review the SMART and highlight its advantages in constructing and revising adaptive interventions as compared to alternative experimental designs. Selected examples of SMART studies are described and compared. A data analysis method is provided and illustrated using data from the Extending Treatment Effectiveness of Naltrexone SMART study.
Adaptive interventions are interventions in which the type or the dosage of the intervention offered to patients is individualized on the basis of patients' characteristics or clinical presentation and then are repeatedly adjusted over time in response to their ongoing performance (see, for example, Bierman et al. 2006, Marlowe et al. 2008, McKay 2005). This approach is based on the notion that patients differ in their responses to interventions: In order for an intervention to be most effective, it should be individualized and repeatedly adapted over time to individual progress. An adaptive intervention is a multistage process that can be operationalized via a sequence of decision rules that recommend when and how the intervention should be modified in order to maximize long-term primary outcomes. These recommendations are based not only on patients' characteristics but also on intermediate outcomes collected during the intervention, such as the patient's response and adherence. Adaptive interventions are also known as dynamic treatment regimes (Murphy et al. 2001, Robins 1986), adaptive treatment strategies (Lavori & Dawson 2000, Murphy 2005), multi-stage treatment strategies (Thall et al. 2002, Thall & Wathen 2005) and treatment policies (Lunceford et al. 2002; Wahed & Tsiatis 2004, 2006).
The conceptual advantages of adaptive interventions over a fixed-intervention approach (in which all patients are offered the same type or dosage of the intervention) have long been recognized by behavioral scientists. For example, Weisz et al. (2004, pp. 302–303) presented a discussion of dissemination and evidence-based practice in clinical psychology, suggesting that evidence-based practice should ideally consist of much more than simply obtaining an initial diagnosis and choosing a matching treatment:
Evidence-based practice … is not a specific treatment or a set of treatments, but rather an orientation or a value system that relies on evidence to guide the entire treatment process. Thus, a critical element of evidence-based care is periodic assessment to gauge whether the treatment selected initially is in fact proving helpful. If it is not, adjustments in procedures will be necessary, perhaps several times over the course of the treatment.
In recent years, intervention scientists have become increasingly interested in experimental designs that explicitly inform the adaptive aspects of the intervention. The general aim is to obtain data useful for addressing questions concerning the individualization and adaptation of intervention options so as to construct high-quality (i.e., highly efficacious) adaptive interventions. Here, we discuss an experimental design useful for developing (i.e., for constructing or revising) adaptive interventions in the area of behavioral health. First we review how decision rules can be used to operationalize the individualization of intervention options (i.e., intervention type and dosage) on the basis of patients' characteristics and the repeated adaptation of intervention options over time in response to the ongoing performance of the patient. Next we discuss how the Sequential Multiple Assignment Randomized Trial (SMART) (Murphy 2005; Murphy et al. 2007a,b; for precursors and related ideas, see also Lavori & Dawson 2000, 2004) can be used to develop adaptive interventions. More specifically, we discuss how data from SMART designs are useful in addressing key research questions that inform the construction of a high-quality adaptive intervention. We discuss the advantages of SMART relative to other experimental approaches and describe four selected examples of SMART studies that are ongoing or completed. Finally, we provide a data analysis method for addressing several interesting research questions concerning adaptive interventions. We use the Extending Treatment Effectiveness of Naltrexone (ExTENd) SMART study for illustration.
An adaptive intervention consists of four key elements. The first element is a sequence of critical decisions in a patient's care. Critical decisions might concern which intervention to provide first and, if the initial intervention is unsuccessful, which intervention to provide second. In many settings, the risk of relapse or exacerbations is high; thus, critical decisions must be made even after an acute response has been achieved. These decisions may concern which maintenance intervention should be offered and whether and how signs of impending relapse should be monitored (McKay 2009). The second element is a set of possible intervention options at each critical decision point. Possible intervention options include different types of behavioral and pharmacological interventions, different modes of delivery, different combinations of interventions, different approaches to enhance engagement and adherence to the intervention, and different intervention timelines. The third element is a set of tailoring variables that is used to pinpoint when the intervention should be altered and to identify which intervention option is best for whom. These variables usually include information that is useful in detecting early signs that the intervention is insufficiently effective (e.g., early signs of nonresponse to intervention, adherence, side effects, and burden), but it can also include contextual information (e.g., individual, family, social, and environmental characteristics) as well as information concerning the intervention options already received. The logic is that the best intervention option for patients varies according to different values of the tailoring variables. The fourth ingredient is a sequence of decision rules, one rule per critical decision. The decision rule links individuals' characteristics and ongoing performance with specific intervention options. The aim of these decision rules is to guide practitioners in deciding which intervention options to use at each stage of the adaptive intervention based on available information relating to the characteristics and/or ongoing performance of the patient. Each decision rule inputs the tailoring variables and outputs one or more recommended intervention options (Collins et al. 2004; Lavori & Dawson 2000, 2004; Lavori et al. 2000).
There are many reasons for considering adaptive interventions for the prevention and treatment of mental health disorders. First, patients may vary in their response to treatment. Some patients may respond whereas others may not respond to the same intervention type, intensity, or duration. For example, in a clinical trial of four psychosocial interventions for cocaine dependence (Crits-Christoph et al. 1999, Stulz et al. 2010), 35% to 60% of patients were continuing to use cocaine at the end of the six-month intervention. This motivates the provision of subsequent intervention options for patients who do not respond adequately to the initial intervention. These options often include switching to an alternative intervention or increasing the dose/intensity of the intervention. Second, the effectiveness of an intervention may change over time due to dynamically evolving risk and resiliency or waxing and waning of the disorder (Angst et al. 2009, Hser et al. 2007). Hence, it is important to decide if and when the intervention is no longer working and, accordingly, which intervention should follow. A third reason for considering an adaptive intervention is the presence of, or evolving, comorbidities (e.g., comorbid HIV infection and substance use, depression and alcoholism). Comorbid conditions require decisions regarding which disorder should be treated first or whether multiple disorders should be treated simultaneously. A fourth reason is that relapse may be common. For example, in the treatment of substance abuse, patients are at high risk for relapse even after achieving an acute response (McKay 2009, McKay et al. 2010, McLellan 2002, McLellan et al. 2000). Fifth, the high cost of intensive interventions combined with possible burden and/or side effects motivate the development of interventions in which the intensity of the treatment is reduced when possible. Finally, difficulties in maintaining adherence to interventions are another important reason to consider adaptive interventions. For example, adherence to treatment with antipsychotic medications by patients with schizophrenia ranges from 45% to 63% (Liu-Seifert et al. 2012). Low adherence motivates the development of interventions in which the type or intensity of the treatment is tailored to encourage adherence. To clarify these ideas, consider the following abbreviated description of the Adaptive Drug Court Program implemented by Marlowe et al. (2008).
The Adaptive Drug Court Program was implemented by Marlowe and colleagues (2008) for individuals charged with a drug-related misdemeanor offense. At entry into the program, offenders were classified as high risk for failure if they met the criteria in the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, for antisocial personality disorder or had previously attended at least one formal drug abuse intervention, excluding self-help groups; otherwise offenders were classified as low risk. Offenders who were classified as high risk were assigned to biweekly court hearings, whereas offenders classified as low risk were assigned to as-needed court hearings. In addition to the court hearings, all offenders were required to attend weekly group substance abuse counseling sessions and to provide weekly urine specimens.
Each offender's progress in the program was assessed monthly. If at any monthly assessment an offender had missed two or more counseling sessions without an excuse or failed to provide two or more scheduled urine specimens, he/she was classified as noncompliant, and the level of court supervision was increased. In particular, offenders who were assigned to as-needed court hearings but did not comply moved to biweekly court hearings; offenders who were assigned to biweekly court hearings but did not comply were placed on a jeopardy contract in which further violation of the rules of the program resulted in moving into a regular court system. If an offender attended the scheduled counseling sessions, provided the urine specimens and did not commit new infractions, but two or more urine specimens were drug-positive, then the offender was classified as nonresponsive. In this case, the intensity and scope of the drug abuse treatment were altered. More specifically, these offenders entered an intensive case management program in which they were provided twice-weekly individual substance abuse counseling sessions. Offenders who were both compliant and responsive continued on the initially assigned program. Table 1 and Figure 1 describe the decision rules that operationalize the Adaptive Drug Court Program.
In this adaptive intervention, two critical decisions must be made regarding (a) the initial intensity of intervention (court hearings) and (b) how to alter the intervention in response to the ongoing performance of the offender. When making the first critical decision, available intervention options include as-needed court hearings and biweekly court hearings. The tailoring variable for the initial intervention is the risk level of the offender (high risk or low risk). The subsequent intervention options are referral to an intensive clinical case management program, instituting a jeopardy contract, instituting a more intensive court hearing schedule, or continuing the previous court hearing schedule. The tailoring variable for the subsequent intervention is how well offenders were progressing in the program, in particular whether the offender is noncompliant, nonresponsive but compliant, or both compliant and responsive.
Sequential Multiple Assignment Randomized Trials (Dawson & Lavori 2011, Lavori & Dawson 2000, Murphy 2005) are used to inform the development of adaptive interventions. A SMART involves multiple intervention stages; each stage corresponds to one of the critical decisions involved in the adaptive intervention. Each participant moves through the multiple stages, and at each stage the participant is randomly (re)assigned to one of several intervention options. As in standard intervention trials, the randomization allows scientists to make valid causal inferences concerning the relative effectiveness of the intervention options without having to make unverifiable assumptions (Rubin 1974, 2007). Because SMARTs are used to develop adaptive interventions as opposed to confirming that a particular adaptive intervention is better than control, SMARTs should be followed by a randomized confirmatory trial in which the developed adaptive intervention is compared to an appropriate alternative. It is worth noting that although SMARTs involve randomization, once an adaptive intervention has been constructed, the delivery of the adaptive intervention does not involve randomization.
Trials in which participants are randomized multiple times have been implemented in a variety of fields, likely beginning in cancer research (Joss et al. 1994, Stone et al. 1995, Tummarello et al. 1997). Other precursors of SMART include the CATIE trial of treatments for patients with Alzheimer's disease (Schneider et al. 2003) and STAR*D for treatment of depression (Rush et al. 2004, 2006). Recently concluded SMART trials include the CATIE trial of treatments for schizophrenia (Stroup et al. 2003), Phase II trials at University of Texas MD Anderson Cancer Center for treating cancer (Thall et al. 2007a), the ExTENd trial of treatments for alcohol dependence by Oslin (2005) at the University of Pennsylvania, and a SMART study of treatments for children with attention deficit/hyperactivity disorder (ADHD) by W. Pelham at the University at Buffalo, SUNY (personal communication). Trials currently in the field include a SMART for nonverbal children with autism by Kasari (2009a,b) at UCLA, a SMART concerning behavioral interventions for drug-addicted pregnant women by Jones (2010) at the Johns Hopkins University, and a SMART for the treatment of metastatic renal cell carcinoma by Tannir (2010) at the University of Texas MD Anderson Cancer Center.
To make the discussion more concrete, consider the SMART concerning behavioral interventions for drug-addicted pregnant women. This trial is designed to provide data regarding how the intensity and scope of reinforcement-based treatment (RBT) might be adapted to a pregnant woman's progress in treatment. There are four types of RBT: abbreviated RBT (aRBT), reduced RBT (rRBT), treatment-as-usual RBT (tRBT), and enhanced RBT (eRBT), listed in order of increasing intensity and scope. In this trial, each participant is randomized to one of the two possible initial interventions (tRBT or rRBT). After two weeks, participants are classified as either nonresponders or responders. A participant is classified as a nonresponder if she misses an intervention day with no excuse, provides a positive opioid or cocaine urine specimen, or self-reports using either drug; otherwise the participant is classified as a responder. Then each nonresponder is rerandomized to one of two subsequent interventions that are equally as intensive as or are more intensive (in terms of dose and scope) than the initial intervention. Specifically, nonresponders to tRBT are rerandomized to either tRBT or eRBT, and nonresponders to rRBT are rerandomized to either rRBT or tRBT. Each responder is randomized to one of two subsequent interventions that are equally as intensive as or are less intensive (in terms of dose and scope) than the initial intervention that was offered to the participant. Responders to rRBT are rerandomized to either rRBT or aRBT, and responders to tRBT are rerandomized to either rRBT or tRBT. The SMART study design is illustrated in Figure 2. Eight adaptive interventions are embedded in this design (Table 2). In the examples section we provide more details concerning this SMART study.
As stated above, the goal of the SMART design is to inform the development of adaptive interventions. Data from a SMART design can be used to address many interesting questions that are useful for the construction of high-quality adaptive intervention. These questions may concern the comparison of different intervention options at different stages of the intervention. For example, comparisons may be made of the difference between the first-stage intervention options (rRBT and tRBT) in the context of the specified second-stage intervention options or of the difference between the secondstage intervention options for nonresponding or responding participants. Other questions may concern the comparison of adaptive interventions that are embedded in the SMART trial, such as the differences between the eight adaptive interventions specified in Table 2. Data from a SMART design can also be used to address questions that concern the construction of more deeply tailored adaptive interventions that go beyond those explicitly embedded as part of the SMART design. Specifically, investigators can collect information on candidate tailoring variables that are outcomes of the initial intervention and assess their usefulness in matching subsequent intervention options to participants. For example, in the secondary analysis of data from the RBT SMART study described above, one interesting question might be, "Does the effect of the second-stage intervention options (i.e., the difference between rRBT and tRBT) for nonresponders to rRBT vary depending on the participant's RBT skill comprehension measured during the first-stage of the intervention?" Addressing this question may improve the primary outcome through greater individualization.
Recall that the SMART experimental design was developed to aid in the construction and refinement of adaptive interventions. With this goal in mind, at least two other plausible experimental alternatives to the SMART are possible: (a) the use of multiple, one-stage-at-a-time, randomized trials and (b) a randomized trial in which a fully formed adaptive intervention is compared to an appropriate alternative. Advantages and disadvantages of the SMART design relative to these approaches are discussed below.
Consider the first plausible alternative to the SMART design, that of employing multiple, one-stage-at-a-time, randomized trials. This approach focuses separately on each intervention stage composing the sequence as opposed to viewing the intervention sequence as a whole. For clarity, suppose the critical decisions are (a) which intervention to provide initially, (b) which intervention to provide to responders, and (c) which intervention to provide to nonresponders. The one-stage-at-a-time approach would utilize three randomized trials, one per critical decision. This is a very attractive option because often the initial interventions have been evaluated in prior studies. The intervention that performed best in these prior studies is selected as the first-stage intervention. Thus, a natural next step is to conduct two studies: a study of intervention responders and a study of intervention nonresponders. The adaptive intervention obtained this way consists of the selected first-stage intervention followed by offering the intervention that was found to perform best in the study involving responders, and offering the intervention option that was found to perform best in the study of nonresponders.
The SMART design has at least three advantages as compared to multiple, one-stage-at-a-time, randomized trials in developing adaptive interventions. These advantages are (a) increased validity of analyses aimed at discovering when the effect of one intervention is enhanced by subsequent or prior interventions, (b) increased validity of analyses aimed at discovering useful tailoring variables, and (c) increased ability to reduce the impact of cohort effects. All three advantages enhance the ability of scientists to construct high-quality adaptive interventions. In the multiple, one-stage-at-a-time, randomized trials approach, scientists can attempt to detect synergistic effects by collecting retrospective information about the type and intensity of the interventions participants received prior to nonresponse (or prior to response). In contrast, in a SMART study the clinical team can prospectively manipulate and record the type and intensity of the intervention during the initial stage.
The second advantage of the SMART design as compared to multiple, one-stage-at-a-time, randomized trials is that the SMART design enhances the ability of researchers to assess whether outcomes to the initial intervention might be useful in individualizing the subsequent intervention. For example, in secondary data analyses of the ADHD study, Nahum-Shani et al. (2011a,b) found evidence that children's adherence to the first-stage intervention could be used to individualize the second-stage intervention. Among children who do not respond to the first-stage intervention (either low-dose medication or low-dose behavioral modification), those with low adherence performed better when the first-stage intervention was augmented with the other type of intervention, relative to increasing the dose or intensity of the first-stage intervention. One might try to obtain information concerning adherence to the first-stage intervention in a nonresponders study by asking participants to retrospectively report their level of adherence to the intervention provided to them before they entered the nonresponders study. However, the quality and validity of these recall measures might be lower relative to the more proximally measured adherence collected during the SMART study.
The third advantage of the SMART design as compared to multiple, one-stage-at-a-time, randomized trials is that it facilitates the avoidance of deleterious cohort effects (for more details, see Murphy et al. 2007b and Nahum-Shani et al. 2011a,b) because participants who remain in a SMART study may be more representative of the population than are participants who enroll and remain in single-stage trials. There are two reasons why this may be the case. The first is related to the fact many single-stage trials are used to compare a set of interventions that are fixed over time; thus, participants who do not respond well to their assigned intervention have no options other than nonadherence or drop-out from the study. The lack of options for nonimproving participants within the context of the trial may lead to study attrition or nonadherence. Since the SMART design alters the intervention of nonresponding participants, these participants may be more likely to remain in the study than would be the case if the intervention were not altered. Alternately, if participants do well, then the intensity or burden of the intervention may be reduced. The second reason why one can expect to recruit a more representative group of participants who remain in SMART studies than would otherwise be the case is because the group of nonresponders to the initial treatment can be expected to be more representative of treatment nonresponders in general. That is, to the extent that nonresponders who are willing to enroll in a nonresponders study are more motivated to adhere and are more receptive to the intervention than the general population of nonresponders, the single-stage nonresponders study will lead to nonrepresentative results.
As mentioned above, the second plausible alternative to a SMART design is a randomized trial in which participants are randomized between a fully formed adaptive intervention and an appropriate alternative (standard or usual care, attention control, etc.). In this case researchers might utilize available literature, clinical experience, results from prior randomized trials, and a variety of well-established theoretical principles [e.g., the stepped care model by Sobell & Sobell (2000) advocates starting patients on the least intensive intervention and stepping up only when necessary] to completely formulate the adaptive intervention. This includes selecting the tailoring variables, operationalizing the decision rules, and deciding which interventions will be employed in each stage.
The advantages of SMART designs over a randomized comparison of the fully formed adaptive intervention with a control are related to the fact that the SMART design enables clinical scientists to open the "black box" using randomized comparisons. In contrast, the randomized two-group comparison approach is designed with a very different goal, that is, to provide information on whether the adaptive intervention outperforms the best alternative. SMART designs can be used to proactively compare intervention options (e.g., the dose, the type of the intervention, the timing of the treatment) at different stages of the adaptive intervention. To address these issues in a randomized two-group trial setting, investigators would have to rely on nonexperimental variation in intervention options received (e.g., variation in dose due to nonadherence or implementation infidelity). Secondary analysis of data from SMART studies may also assess the usefulness of candidate tailoring variables at each stage. This enables us to address questions of clinical and theoretical interest such as whether the intervention provided to nonresponding patients should differ depending on the patient's level of adherence to the initial intervention. In a randomized two-group trial, there is no randomization to different second-stage interventions, and thus again analyses must depend on variation due to nonadherence and implementation infidelity. It is well known that untestable, strong assumptions must hold to ensure that findings based on such nonrandomized comparisons are not biased by confounding (Hernán et al. 2000, 2002; Robins et al. 2000).
The adaptive experimental design is defined by Dragalin (2006) as a multistage study design in which accumulating data are used to decide how to modify aspects of the study without undermining the validity and integrity of the trial. Chow & Chang (2008) provide a thorough review of various types of adaptive experimental designs. The adjective "adaptive" comes from the fact that these experimental designs are adapted in that the randomization probabilities for future participants are biased toward the best-performing interventions. In one type of adaptive experimental design, called a group sequential design, decisions concerning whether to stop the trial early and whether to adjust the target sample size are based on outcome data from the participants enrolled earlier in the trial (Pocock 1977; for examples, see Bandyopadhyay & Dragalin 2007, Honigmann et al. 2007).
The SMART experimental design and the adaptive experimental design are quite different experimental approaches. Although both approaches involve multiple stages, the word "stage" has a different meaning in SMARTs as opposed to its meaning in adaptive experimental designs. In SMART designs, each stage is an intervention stage that corresponds to a critical decision point in the care for a patient, whereas in adaptive experimental designs, each stage corresponds to an experimental stage that involves a new set of participants. The word "adaptive" also has a different meaning in the context of SMARTs as opposed to adaptive experimental designs. In SMART designs, the intervention offered to a specific participant is adapted on the basis of information obtained on this participant (e.g., the participant's signs of early response or level of adherence to the initial interventions), whereas in adaptive experimental designs, the randomization probabilities are adapted on the basis of information obtained from other participants in prior stages (e.g., to the primary outcomes obtained from other participants). Recently, methodologists have proposed adaptive experimental designs for use in developing individualized or personalized one-stage interventions (Zhou et al. 2008). Furthermore, Thall and colleagues (2007b) have proposed combining the adaptive experimental design with the SMART design for use in constructing adaptive interventions in cancer treatment.
Below we provide examples of four SMART studies that are completed or currently ongoing: (a) the Adaptive Characterizing Cognition in Nonverbal Individuals with Autism (CCNIA) Developmental and Augmented Intervention (Kasari 2009a,b) for school-age, nonverbal, children with autism spectrum disorders; (b) the Adaptive Pharmacological and Behavioral Treatments for children with ADHD; (c) the Adaptive Reinforcement-Based Treatment for Pregnant Drug Abusers (RBT) ( Jones 2010); and (d) the ExTENd study for alcohol-dependent individuals (Oslin 2005). After reviewing the studies, we discuss similarities and differences between the designs. We use the ExTENd study to illustrate how one can analyze the data resulting from SMART studies in the section titled Using Data from a SMART to Inform the Construction of an Optimized Adaptive Intervention.
The Adaptive CCNIA Developmental and Augmented Intervention Study (C. Kasari, P.I.) focuses on nonverbal children with autism spectrum disorders who have not made satisfactory progress by age 5 even though they have received traditional intensive interventions. These children experience poorer long-term outcomes (Lord 2000) than those of verbal children with autism spectrum disorders. When this trial was designed, no known efficacious interventions existed for these children, even though they represent 25% to 30% of children with autism spectrum disorders (Anderson et al. 2007). Given the lack of known efficacious interventions combined with the poor outcomes of traditional interventions, the research team was interested in planning a "rescue" intervention that would be used if the initial intervention was insufficiently successful. Thus, the critical questions that motivated this study include which intervention to provide initially and, if the child does not improve his/her expressive language skills, which rescue intervention to provide.
The joint attention/joint engagement (JAE) intervention was combined with two interventions, enhanced milieu teaching (EMT) and augmentative and alternative communication (AAC). JAE (Adamson et al. 2004; Kasari et al. 2006, 2008) was developed to facilitate a state of supported or coordinated joint engagement between the child and a social partner. Both EMT and AAC were developed to facilitate expressive language in young children with developmental disabilities. EMT (Hancock & Kaiser 2006) is a naturalistic language intervention that promotes functional use of new language forms in the context of everyday interactions with parents and other social partners. The AAC intervention utilizes a developmentally chosen augmentative communication device (Cafiero 2005) to facilitate communicative exchanges within play routines and daily activities. Both EMT and AAC were adapted for 5- to 8-year-old children and integrated with JAE to form two interventions, JAE+EMT and JAE+AAC. More intensive versions of both JAE+EMT and JAE+AAC included additional sessions provided by a skilled child therapist and additional training with the parent to promote parent and child generalization. Parents are also encouraged to implement the strategies they learned in the intervention across home routines, thereby potentially increasing the hours of interventions children receive. Overall, four intervention options are considered: JAE+EMT, JAE+AAC, intensified JAE+EMT, and intensified JAE+AAC.
To determine whether a child is exhibiting early signs of response to the initial intervention, the investigators used assessments of the child's improvement in (a) total social communicative utterances, (b) percentage communicative utterances, (c) number different word roots, (d) mean length of utterance in words, (e) number of utterances where the function is to comment (rather than request), (f) words perminute, and (g) unique word combinations (included only if the child's target talk consists of more than two words). These assessments address the range of changes in spoken and augmented language that might be expected in three months and that represent meaningful language change. Using these assessments, the investigators constructed 14 variables that represent change in spoken and augmented language, two per each of the seven assessments. More specifically, for each assessment, the first variable was calculated as the difference in the average assessment between the first two intervention sessions and the last two intervention sessions during the first stage of the intervention; the second variable was calculated as the difference between the assessment at the screening visit and the month-three visit. The above measures are collected via videotapes of the child and therapist sessions.
As shown in Figure 3, at the first stage of the intervention, children are randomized to JAE+EMT or JAE+AAC. This stage lasts three months, during which children in both intervention arms receive biweekly intervention sessions. After three months, children are classified as responders or nonresponders to the initial intervention. The criterion for response is 25% or more improvement on at least 50% of the 14 measures described above. Children who do not meet this criterion are classified as nonresponders. The second stage is also of three months' duration. At this stage, children who respond to the initial interventions continue with the same initial intervention. Children who do not respond to initial JAE+EMT are randomly assigned either to receive intensified JAE+EMT or to switch to JAE+AAC. Because taking the augmentative communication device from children who do not respond to JAE+AAC was deemed inappropriate, intensified JAE+AAC is offered to children who are classified as nonresponders to JAE+AAC. The total study duration is six months, with a follow-up assessment at nine months.
Three adaptive interventions are embedded in this SMART design: (a) Begin with JAE+EMT, and after three months, continue JAE+EMT if the child adequately responds, or switch to JAE+AAC if the child does not respond; (b) begin with JAE+EMT, and after three months, continue JAE+EMT if the child adequately responds, or offer more intensive JAE+EMT if the child does not respond; and (c) begin with JAE+AAC, and after three months, continue JAE+AAC if the child adequately responds, or offer more intensive JAE+AAC if the child does not respond.
Outcomes include three time-varying variables that measure communicative and expressive language abilities: (a) the number of words used spontaneously during parent-child interaction, (b) the number of communicative functions used for each word during parent-child interactions, and (c) the generalization of spontaneous words to express multiple communication functions. These variables are obtained from videotapes of child-mother interactions. The primary aim of this study is to test the main effect of beginning with JAE+AAC versus beginning with JAE+EMT on the above time-varying outcomes. A secondary aim of the study is to examine potential baseline moderators of the difference between the three embedded adaptive interventions. The baseline variables included severity of repetitive/compulsive behaviors, degree of apraxia, and developmental variables (based on cognitive and language test results). In particular, the research team hypothesized that children with greater severity of apraxia would do better on JAE+AAC than on JAE+EMT because the communication device would better provide a means to communicate.
In contrast to the setting for the CCNIA study, a number of acutely effective pharmacological and behavioral interventions are presently available for treating children with ADHD (e.g., Fabiano et al. 2009, Hammerness et al. 2009, Pelham & Fabiano 2008, Wigal et al. 2011). There has been considerable debate, however, on whether the first-line intervention should be pharmacological or behavioral; for example, a task force of the American Psychological Association recommends psychosocial first (Brown et al. 2007), whereas the guidelines of the American Academy of Child and Adolescent Psychiatry (2007) recommend using medication first. Thus a critical decision is whether to initially use a behavioral or pharmacological intervention. Because anywhere from 20% to 50% of children can be expected to insufficiently respond to the initial intervention, a second critical decision concerns the choice of "rescue" intervention for these children.
The interventions include differing doses of methylphenidate (a psychostimulant drug) and differing intensities of behavioral modification (consisting of a school-based component with the teacher, a Saturday treatment component involving social skills development, and a parent-training component targeted at helping parents to identify problematic behaviors with the relevant child-functioning domains). The higher-dose option for methylphenidate includes late-afternoon doses, if needed. The higher-intensity option for the behavioral modification includes more intensive training in social skills in the school-based component and, if needed, both additional individual parent training sessions that target specific behavior management issues and practice sessions with children.
Two well-known instruments were employed to assess whether children were responding to the first-stage intervention: the Impairment Rating Scale (IRS) (Fabiano et al. 2006) and an individualized list of target behaviors (ITB) (e.g., Pelham et al. 1992). The IRS provides a comprehensive index of a child's impairment in various domains such as peer relationships, classroom behavior, family functioning, and academic achievement. The ITB was used to assess improvement on child-specific behavior goals. Both were reported by the regular classroom teachers.
As shown in Figure 4, children were randomly assigned to begin with low-intensity behavioral modification or with low-dose medication. This stage lasts two months, after which the ratings from IRS and ITB were used monthly to assess the child's response to the initial intervention. The criterion for nonresponse at each month was an average performance of less than 75% on the ITB and a rating of impairment in at least one domain on the IRS. Children who did not meet the criteria for nonresponse continued with the initial intervention assigned to them, whereas nonresponders were rerandomized. There are two ways to conceptualize the second-stage intervention options that were offered to non-responders. One way would be to focus on the type of the intervention offered. Children who did not respond adequately to low-intensity behavioral modification were rerandomized to either an intensified behavioral modification or to behavioral modification augmented with medication, whereas children who did not respond adequately to low-dose medication were rerandomized to either increased dose of medication or to medication augmented with behavioral modification. Another way to frame the second-stage options for nonresponders would be to focus on the intervention tactic. That is, all nonresponders were rerandomized either to receive an intensified version of the initial intervention or to augment the initial intervention with the alternative intervention option. The study duration was eight months during a school year, with a follow-up assessment during November of the following school year.
Four adaptive interventions are embedded in this design. For example, low-intensity behavioral modification is offered at the start; if the child does not respond adequately, the intervention is augmented with a low dose of medication; otherwise, behavioral modification of the same intensity is continued.
Outcome measures included time-varying teacher and parent ratings of child behavior as well as the ending dosages of the behavioral modification and medication. The primary aim of this study was to test the main effect of beginning with low-dose medication versus beginning with low-intensity behavioral modification on the rate of nonresponse and ending dosages. Secondary aims included assessing how baseline variables (e.g., severity of impairment, comorbid child psychopathology, and prior medication history) influence (a) the difference between the two initial interventions, (b) the difference between the second-stage intervention options for nonresponding children, and (c) the difference between the four adaptive interventions embedded in the design.
Prenatal drug use is often associated with an increased risk of pregnancy complications and adverse neonatal outcomes such as pre-eclampsia, stillbirth, and premature labor. RBT has been shown to be an efficacious intervention ( Jones et al. 2005, 2011); however, two obstacles remain. First, RBT is time-consuming on the part of the participant, and second, about 40% of participants do not respond as well as desired. Thus, the aim of this study is to address three critical questions: (a) Whether the frontline version of RBT can be reduced in intensity and scope; (b) whether a woman who does not respond quickly to the frontline version of RBT should continue on the same version or be moved to a more-intensive, larger-scope version of RBT; and (c) whether the intensity and scope of RBT can be reduced if a woman responds quickly to the frontline version. The general aim of this study is to develop an RBT-based adaptive intervention that is more cost-effective.
In this design, four variants of one successful multicomponent intervention, RBT, are being considered. RBT focuses on areas of change that are likely to reduce drug use or chances of relapse by facilitating participants with nondrug-related reinforcers such as life skills training, recreational therapy, and employment. The four RBT variants, ordered in increasing intensity and scope, are aRBT, rRBT, tRBT, and eRBT. tRBT includes 11 key elements:
rRBT consists of all elements in tRBT, with some of the key elements provided in a reduced level. For example, social and job club are provided once a week compared with three times a week in tRBT. In aRBT, the least-intense version of RBT, the scope and frequencies of some of the RBT components are further reduced. For example, behavioral raphing focuses only on drug abstinence, and no tangible reinforcers are provided. Individual therapy sessions are provided once a week compared with three times per week in tRBT, and recreational activities and job club are held less frequently. eRBT is the most-intense version of RBT. It provides participants with additional intervention sessions, such as home visits due to nonresponse or relapse. For example, individual therapy sessions in eRBT are held twice as often as in tRBT.
Since early drug use lapse or relapse and adherence are known predictors of poor intervention response (Ciraulo et al. 2003), response is assessed via self-reported drug use, results of urine tests, and attendance on intervention days.
As shown in Figure 2, at the first stage of the intervention, participants are randomly assigned to either tRBT or rRBT. After two weeks, participants are classified as responders or nonresponders to the first-stage intervention. The criterion for nonresponse is missing an intervention day with no excuse, or a positive opioid/cocaine urine specimen, or self-report use of either drug. At the second stage, nonresponders are rerandomized to one of the two possible subsequent interventions that are as intensive or more intensive in dose and scope as the initial intervention. More specifically, nonresponders to tRBT are rerandomized to either tRBT or eRBT, whereas nonresponders to rRBT are rerandomized to either rRBT or tRBT. Responders are randomized to one of the two subsequent interventions that are as intensive or less intensive in dose and scope as the initial intervention. More specifically, responders to rRBT are rerandomized to either rRBT or aRBT, whereas responders to tRBT are rerandomized to either tRBT or rRBT. The study duration is the duration of the pregnancy plus six weeks postpartum.
Because both responders and nonresponders are rerandomized in this study, eight adaptive interventions are embedded in this SMART design. An example of an embedded adaptive intervention is to begin by offering rRBT; after two weeks, continue rRBT if the patient is showing adequate response; otherwise, switch to tRBT.
Primary outcomes include treatment completion (delivery while in program) and heroin and cocaine use. A primary aim of the study is to compare always tRBT (i.e., offering tRBT throughout the pregnancy) with always rRBT (i.e., offering rRBT throughout the pregnancy). This primary aim concerns the comparison of two nonadaptive interventions (always tRBT versus always rRBT) that are embedded in the design. Secondary aims involve assessing the usefulness of candidate tailoring variables, such as the amount of illegal activity (e.g., prostitution).
NTX is an opioid receptor antagonist used in the prevention of relapse to alcoholism. Even though NTX has been shown to be efficacious, its use by clinicians has been limited. One reason is that it is difficult to adhere to NTX because this drug diminishes the pleasurable effects of alcohol use. Furthermore, from a clinical perspective, there is little guidance in answering critical questions such as (a) the extent of drinking behavior that reflects nonresponse to NTX, (b) the type of treatment that would be useful for participants who do not respond adequately to NTX, and (c) the type of treatment that would be useful in reducing the chance of relapse among individuals who respond adequately to NTX. The ExTENd SMART study (D. Oslin, P.I.) was designed to address these three critical questions. Notice that the first critical question in the ExTENd study concerns the definition of nonresponse, that is, the number of heavy drinking days that should be used as the criteria for classifying a participant as an early nonresponder to NTX.
Four interventions are considered. These are NTX, medical management (MM), combined behavioral intervention (CBI), and telephone disease management (TDM). MM is a face-to-face, basic, minimal clinical support for the use of effective pharmacotherapy and reduction in drinking (Pettinati et al. 2004, 2005). CBI is a multicomponent intervention that includes components targeting adherence to pharmacotherapy and enhancement of participant motivation for change. This intervention includes family involvement when possible and emphasizes the utilization of the participant's social/community context to reinforce abstinence (Longabaugh et al. 2005, Miller et al. 2003). TDM includes the same content as MM, but it is delivered via telephone.
The number of self-reported heavy drinking days was used to assess early nonresponse to NTX.
The design of the trial is shown in Figure 5. The same initial intervention (NTX+MM) was provided to all participants. The randomization at the first stage was to one of two criteria for classifying a participant as an early nonresponder: (a) the stringent criterion for nonresponse, in which two or more heavy drinking days during the first eight weeks of NTX treatment is defined as nonresponse, or (b) the lenient criterion for nonresponse, in which five or more heavy drinking days during the first eight weeks of NTX treatment is defined as nonresponse. Participants were assessed weekly for drinking behavior. If a participant met his/her assigned criteria for nonresponse during the first eight weeks of NTX treatment, he/she was immediately rerandomized to one of the two rescue intervention options for nonresponders: CBI+MM+NTX or CBI+MM+placebo. If the participant did not meet his/her assigned nonresponse criteria during the first eight weeks of NTX treatment, he/she was rerandomized at the end of week eight to one of the two "maintenance" intervention options for responders: to either open-label NTX+TDM or open-label NTX. The study duration was six months.
Eight adaptive interventions are embedded in this SMART design. One example is to begin with NTX+MM for up to eight weeks; if the patient experiences two or more heavy drinking days during these eight weeks, immediately offer CBI+MM+NTX; otherwise, after eight weeks provide NTX+TDM.
The primary outcomes are the percent of heavy drinking days and percent drinking days over the last two months of the study. A primary aim was to test the main effect of the rescue intervention options for nonresponders, that is, whether there is a difference in drinking outcomes for nonresponding participants treated with CBI+MM+NTX versus CBI+MM+placebo. A secondary aim of the study was to assess candidate-tailoring variables for the rescue intervention options for nonresponders. One candidate-tailoring variable was the average daily pill counts during the first stage of the intervention, measured by pill counts from blister cards. Note that this variable is an outcome of the first-stage intervention (NTX+MM) as opposed to a baseline variable.
The four examples of SMART studies (i.e., the CCNIA, ADHD, RBT, and ExTENd) discussed above can be compared along four key dimensions: (a) the extent of multiple randomizations used in the design; (b) the nature of the randomizations used, or in other words, the type of the critical decisions addressed by the randomizations; (c) the extent of treatment modalities underlying the intervention options that are offered; and (d ) the primary questions the study was sized to address.
Concerning the first dimension, the four studies described above are ordered to reflect the extent to which multiple randomizations were used in the design. In the CCNIA study, only a subset of the nonresponding children is rerandomized. Specifically, children who do not respond to JAE+EMT are randomly assigned either to receive intensified JAE+EMT or to switch to JAE+AAC. In this study, the decision not to rerandomize nonresponders to JAE+AAC was made for ethical considerations. Switching from JAE+AAC to JAE+EMT would mean that the communication device that was given to children as part of JAE+AAC had to be taken away. The researchers felt that this was ethically inappropriate and hence do not rerandomize children who do not respond to JAE+AAC, but rather offer an intensified version of JAE+AAC. The ADHD study, on the other hand, involved rerandomization of nonresponders in both arms of the initial intervention (i.e., medication and behavioral modification). Guided by past studies, the investigators expected a nonnegligible rate of nonresponse to both frontline low-dose interventions. Hence, they were interested in finding the best rescue intervention for children who showed early signs of nonresponse. Children who responded to the frontline intervention were not rerandomized in this study. The use of randomization is even greater in the RBT study, in which responders and nonresponders to both initial interventions are rerandomized. Acknowledging the burden associated with the frontline intervention, the investigators were interested not only in finding the best rescue intervention for nonresponding participants but also in assessing whether the intensity of the frontline intervention could be reduced for responding participants. Similarly, in the ExTENd design, both responders and nonresponders were rerandomized.
Notice that the number of adaptive interventions embedded in the SMART design increases to the extent that the design involves more randomizations, that is, to the extent that the design addresses more critical decisions. Only three adaptive interventions are embedded in the CCNIA SMART design, in which only two critical decisions were addressed by randomization: one concerning the frontline intervention and the other concerning the rescue intervention for nonresponders to one of the frontline interventions. Four adaptive interventions are embedded in the ADHD SMART design, in which three critical decisions were addressed by the randomizations: The first concerns the frontline intervention, the second concerns the rescue intervention for nonresponders to one of the initial intervention options (i.e., medication), and the third concerns the rescue intervention for nonresponders to the other initial intervention option (i.e., behavioral modification). Finally, eight adaptive interventions are embedded in the RBT and the ExTENd SMART designs, in which five critical decisions were addressed by randomizations. For example, in the RBT study, the five critical decisions concern (a) the frontline intervention options, (b) the rescue intervention options for responders to one of the frontline intervention options (e.g., tRBT), (c) the rescue intervention option for responders to the other frontline intervention option (e.g., rRBT), (d) the maintenance intervention option for nonresponders to one of the frontline intervention options (e.g., tRBT), and (e) the maintenance intervention option for nonresponders to the other frontline intervention option (e.g., rRBT).
Concerning the second dimension, the randomizations in SMART designs may correspond to various types of critical decisions. In the ADHD and the CCNIA trials, the first-stage randomization corresponds to a decision concerning the frontline treatment, in which two different treatment options are compared (medication versus behavioral modification in the case of the ADHD study; JAE+EMT versus JAE+AAC in the case of the CCNIA study). The second-stage randomization in these trials corresponds to a decision concerning the rescue tactics for nonresponding children, where two treatment tactics are compared (intensify versus augment with the alternative intervention options in the case of the ADHD study; intensify versus switch to JAE+AAC in the case of the CCNIA). In the ExTENd study, on the other hand, the first-stage randomization corresponds to a decision concerning the definition of nonresponse or in other words the criteria for classifying participants as nonresponders to NTX (stringent versus lenient definition of nonresponse). The randomizations in SMART designs may correspond to other critical decisions, such as decisions concerning the individual's participation in treatment (e.g., who should set health-related goals, the participant or the care provider?), the location of the intervention offered (e.g., is it better to offer treatment at home or at the clinic?), the provider of the intervention (e.g., should the parent or the teacher intervene?), the mode of delivery (e.g., is face-to-face delivery better than Internet-based delivery?), or the timing of treatment (e.g., is it better to intervene immediately or at some later point?)
Concerning the third dimension, the number of treatment modalities that are involved in SMART studies may vary. For example, the ADHD SMART study contrasts intervention options that are based on two different treatment modalities, behavioral and pharmacological. The RBT SMART study, on the other hand, contrasts variants of the same intervention (RBT) and hence involves only one treatment modality. The number of treatment modalities utilized in SMART studies depends on the scientific evidence and the research questions at hand.
Concerning the fourth dimension, SMART designs may vary in the primary research questions they were sized to address. Most SMART studies are sized to address primary research questions concerning the first-stage randomization. Secondary research questions typically concern (a) the comparison of second-stage intervention options, (b) the comparison of embedded adaptive interventions, and (c) the usefulness of candidate tailoring variables (beyond the tailoring variable already embedded in the design). For example, the ADHD data were sized to address a primary research question concerning the comparison between the two frontline intervention options (i.e., medication and behavioral modification). The secondary research questions concerned the comparison of rescue tactics for nonresponding children, the comparisons of the four adaptive interventions that are embedded in the design, and the usefulness of candidate tailoring variables such as baseline severity of ADHD symptoms and adherence to frontline intervention. Other SMART designs are sized to address a primary research question concerning the second-stage intervention options. For example, in the ExTENd study, the primary aim was to test the main effect of the rescue intervention options for nonresponders to the first-stage intervention (NTX+MM), that is, to assess whether there is a difference in drinking outcomes for nonresponding participants treated with CBI+MM+NTX versus CBI+MM+placebo. SMART designs can also be sized to address primary research questions concerning the adaptive interventions that are embedded in the design. For example, in the RBT study, the primary aim concerns the comparison of two nonadaptive interventions (always tRBT versus always rRBT) that are embedded in the design, and the secondary aims concern the usefulness of candidate tailoring variables such as the amount of illegal activity (e.g., prostitution).
A variety of interesting questions can be addressed using SMART study data. Frequently the primary analysis concerns the main effect of the first-stage intervention options. In the ADHD example, this is the main effect of starting with a low-intensity behavioral modification versus low-dose medication. Additionally, secondary data analyses can be used to assess moderators of the first-stage intervention options, such as baseline participant characteristics. Other data analyses may concern the main effect of the second-stage intervention options. In the ExTENd example, this would be the main effect of NTX+TDM versus NTX alone for responding participants and the main effect of CBI+MM+NTX versus CBI+MM+placebo for nonresponding participants. Secondary data analyses can be used to assess moderators of the effect of the second-stage intervention options such as baseline measures and outcomes observed during the first-stage treatment. Data analyses may also concern the comparison of embedded adaptive interventions. Recall that in the ExTENd study there are eight embedded adaptive interventions. Nahum-Shani et al. (2011a,b) provide analysis methods for addressing primary and secondary research questions using data from SMART studies. Below, we use data from the ExTENd SMART study to illustrate the comparison of the eight embedded adaptive interventions.
The ExTENd study included 302 participants (70% white, 86% male, and 28% above the age of 55). Forty-nine participants dropped out prior to experiencing two heavy drinking days and thus experienced no effect of the first-stage randomization. The effective sample size for the randomized study was 253 participants. Only three additional participants dropped out during the first-stage treatment; the data from these participants were deleted, leaving a sample size of 250 participants. At the first stage, 123 participants were randomized to the stringent definition of nonresponse (two or more heavy drinking days), and 127 participants were randomized to the lenient definition of nonresponse (five or more heaving drinking days). Sixty-seven participants met their assigned definition of nonresponse; of these participants, 34 were rerandomized to CBI+MM+NTX, and the remaining 33 were rerandomized to CBI+MM+placebo. Of the 183 responding participants, 92 were rerandomized to NTX+TDM, and the remaining 91 responders were rerandomized to NTX only. Forty-one participants dropped out at the second stage. To accommodate the resulting missing data, multiple imputation was used in the analyses below.
Recall that the ExTENd study provides data on eight embedded adaptive interventions. The number of participants who contribute data that inform the estimated average of each adaptive intervention is given in Table 3. Each participant is consistent with two adaptive interventions (i.e., the observed primary outcome of each participant is used in estimating the average primary outcome of two adaptive interventions; for more details, see Nahum-Shani et al. 2011a). For example, outcome data that inform the estimated average outcome of two adaptive interventions are provided by a responder who is assigned the stringent definition of nonresponse (two or more heavy drinking days), is responding at the end of eight weeks, and then is assigned to continue on NTX: (a) use a stringent definition of nonresponse, then offer NTX to responders and CBI+MM+NTX to nonresponders; and (b) use a stringent definition of nonresponse, then offer NTX to responders and CBI+MM+placebo to nonresponders.
Data for a participant in the ExTENd trial is denoted by (O1, A1, O2, A2R, A2NR,Y). Here O1 is the vector of pretreatment information described below. A1 denotes the nonresponse definitions at the first stage, coded A1 = 1 for the stringent nonresponse definition (two or more heavy drinking days) and A1 = −1 for the lenient nonresponder definition (five or more heavy drinking days). O2 is the vector of intermediate outcomes, which includes response to the first-stage intervention, drinking behaviors, and adherence to medication. A2R denotes the second-stage intervention options for responding participants, coded A2R = 1 for NTX+TDM and A2R = −1 for NTX. A2NR denotes the second-stage intervention options for nonresponding participants, coded A2NR = 1 for CBI+MM+NTX and A2NR = −1 for CBI+MM+placebo. Y is the primary outcome. For these illustrative analyses, Y is an indicator of whether the participant was (Y = 0) or was not (Y = 1) abstinent between the second and the third visit occurring at the end of the second stage. Baseline measures include the following: (a) percent days of heavy drinking prior to entering the study (PDHD), (b) percent days of drinking but not heavy drinking prior to entering the study (PDNH), (c) gender, (d) ethnicity, (e) age, and (f) education (in years). In coding the two classification variables—gender and ethnicity—male and non-Hispanic/Latino were chosen as the reference categories, respectively. Continuous baseline variables were centered at their median values. The median/mode values are given below (Table 4).
Here we present an illustrative comparison of the eight adaptive interventions embedded in the ExTENd SMART design. We use standard software (e.g., the SAS GENMOD procedure: SAS Inst. 2008) with modifications involving weighting (Nahum-Shani et al. 2011a,b; Orellana et al. 2010; Robins et al. 2008). These modifications are necessary because, as noted above, the data for each participant are consistent with more than one adaptive intervention. The logistic regression model below can be used to compare the eight adaptive interventions embedded in the ExTENd trial:
Here O1 is a vector of selected baseline measures, β0 is the intercept; β1–β3 are the regression coefficients representing the effects of the nonresponse definitions and the second-stage interventions for responders and nonresponders, respectively; β4, β5 are regression coefficients of the interactions between the nonresponse definitions and the second-stage intervention options for responders and nonresponders, respectively; γ is the regression coefficient for the baseline variables. In general, additional interaction terms could be included in Model 1, such as A1*O1, A2R*A2NR, O1*A2R, A1*A2NR*A2R.
The missing data in this data set are handled with multiple imputation using the R mice procedure (van Buuren & Groothuis-Oudshoorn 2010). The estimated coefficients in Model 1 are given in Table 5.1
The results reported in Table 5 indicate that the coefficients of A1, and A1*A2nr are significantly different from zero (1 = 0.39; 5 = −0.14, p < 0.05, respectively), and the coefficient of A2R is marginally significant (2 = −0.24, p = 0.10). The estimated coefficient for A1 is positive, meaning that on average, assigning the lenient definition of nonresponse (five or more heavy drinking days: A1 = −1) is better than assigning the stringent definition of nonresponse (two or more heavy drinking days: A1 = 1) in achieving abstinence at the end of the second stage. The estimated coefficient of A2R is negative, meaning that offering an intensive maintenance intervention (NTX+TDM: A2R = 1) is better than offering the less-intensive maintenance intervention (NTX: A2R = −1) in achieving abstinence at the end of the second stage. Notice that the regression coefficient for A2NR is not significantly different from zero (3 = 0.02), meaning that on average, there is no difference between the two treatment options for nonresponders in achieving abstinence.
Table 3 gives the estimated probability of drinking between the second and the third visit in stage two for each of the eight embedded adaptive interventions (holding the baseline measures constant at their values as specified in Table 4). Each adaptive intervention is abbreviated by a triplet. The first entry represents the nonresponse definition at the first stage, the second entry represents the maintenance intervention assigned to responders, and the third entry represents the rescue intervention assigned to nonresponders. For example, (Stringent, NTX, CBI+MM+NTX) means: Begin with a combination of MM and NTX for up to eight weeks; if the patient has two or more heavy drinking days within eight weeks, offer NTX+CBI+MM; otherwise, after eight weeks offer NTX.
Table 6 compares four pairs of adaptive interventions in terms of the estimated logitP(Y = 1). These four comparisons are of special interest: The four rows (in Table 6) contrast adaptive interventions that begin with different nonresponse definitions. We used the ESTIMATE statement in SAS GENMOD procedure to estimate the linear combination of the estimated coefficients corresponding to each pairwise comparison. We then used the MIANALYZE procedure with these outputs to obtain combined estimatesbasedon10imputed data sets.
The results reported in Table 6 indicate that the adaptive interventions in comparisons 1 and 2 are significantly different in terms of achieving drinking abstinence at the end of stage two [estimated logit P(Y = 1) = −1.17; −0.96, p < 0.05, for comparison 1 and 2, respectively]. Notice that comparisons 1 and 2 include adaptive interventions in which nonresponders are offered the less-intensive second-stage intervention (CBI+MM+placebo). These results indicate that if we are to provide nonresponders with the less-intensive rescue intervention (CBI+MM+placebo), then beginning with the lenient definition of nonresponse (five or more heavy drinking days) will result in better achievement of abstinence at the end of the second stage relative to beginning with the stringent definition of nonresponse (two or more heavy drinking days).
The results reported in Table 6 also indicate that the adaptive interventions in comparisons 3 and 4 are not significantly different in terms of achieving drinking abstinence at the end of stage two [estimated logitP(Y = 1) = −0.61; −0.39, ns, for comparison 3 and 4, respectively]. Notice that comparisons 3 and 4 include adaptive interventions in which nonresponders are offered the more-intensive maintenance intervention (CBI+MM+NTX). These results indicate that we are to provide nonresponders with the more-intensive second-stage intervention (CBI+MM+NTX); it is less clear whether we should begin with the lenient or the stringent definition of nonresponse.
Adaptive interventions are both conceptually and scientifically appealing. Here, we discussed the Sequential Multiple Assignment Randomized Trial (SMART), an experimental design useful for developing adaptive interventions in the area of behavioral health. We also described four selected examples of studies in which SMART designs were utilized to address a variety of critical research questions that inform the development of high-quality adaptive interventions. Similarities and differences between these SMART studies along four key dimensions were discussed. Finally, we used data from the ExTENd SMART study to illustrate data analysis methods for addressing questions concerning adaptive intervention. To conclude, SMART designs are increasingly being used to improve the efficacy and effectiveness of interventions in behavioral health. These designs deserve continued research attention and a prominent role in treatment and prevention research.
We thank Xi Lu for data imputation and Daniel Almirall for valuable comments. We also thank William Pelham, Connie Kasari, and Hendrée Jones for valuable comments and revision in the SMART examples section. We acknowledge support from NIMH grant R01-MH-080015, NIAAA grant R01 AA-014851, NIDA grant P50-DA-010075, and NIAAA grant RC1 AA-019092.
1The coefficients in Model 1 were estimated using the SAS GENMOD procedure (SAS Inst. 2008) for each of 10 imputed data sets. Because each participant's observations are consistent with more than one adaptive intervention, we had the SAS GENMOD procedure (SAS Inst. 2008) provide robust standard errors (for a detailed justification, see Nahum-Shani et al. 2011a,b), which are then used to form the test statistics for Model 1. These are the inputs of the SAS MIANALYZE procedure, which produces estimates and inferences adjusted for the missing data.
The authors receive NIH funds focused on the development of SMART studies; this might be perceived as affecting the objectivity of this review.
PubMed Central Canada is a service of the Canadian Institutes of Health Research (CIHR) working in partnership with the National Research Council's national science library in cooperation with the National Center for Biotechnology Information at the U.S. National Library of Medicine(NCBI/NLM). It includes content provided to the PubMed Central International archive by participating publishers.


text:
I love these Adidas leggings- they are black, with bold print Adidas on right leg. They are true to size, and are super comfortable. I paid around 45$ for them, and I would definitely purchase a second pair. Make sure to hang to dry
These reviews are the subjective opinions of ChickAdvisor members and not of ChickAdvisor Inc.

subset: commoncrawl


text:
I read parts of Oh No, George! by Chris Houghton to remind the children that everyone feels tempted to do things that they know they should not.
Jesus in the dessert is tempted to turn a rock into bread. George left alone at home is tempted to chase the cat and dig up the flowers.
Sometimes we do the wrong thing but it's so important that we try to do better next time.


text:
Curvy Cougar/Milf
25th February 2013 - 19:32 | London UK, London | Age 43
Hi there guys, my name is Claire, I am 42 and live in South London. I'm looking for guys for some naughty fun.
I'm single, and very open minded. I have lots of likes, but role play is one in particular, and I tend to enjoy being a domme, so any guys interested in being submissive come say hi.
I'm looking for white guys only, aged anything over 18 to 55.
I'm also not concerned if you are not single, I offer and expect discretion on here.
I have attached a pic, so please only get in touch with one of you I will not respond without one sorry guys.
Ad No: 52141 | Views: 10,000 | Replies: > 40 | Report Abuse


text:
Three on the 4th from the 2nd
Although the 2nd District has always been one of the best in Ohio in terms of its analysis of the law and the cogency of its opinions, that hasn't always carried over into its work on search and seizure cases, as typified by its holding in a 1998 case that someone with an outstanding arrest warrant has no reasonable expectation of privacy, and thus has no standing to object to a stop or search, no matter how egregiously the police conduct violates the 4th Amendment. It reversed that decision last year, though (although it's up on appeal; see discussion of oral argument here), and in three cases last week showed that it might give the 8th District a run for the title of most 4th-Amendment-friendly court in the state.
State v. Winston is the easiest of the three. It involves the new police tactic, the "knock-and-advise": the police, usually at some housing project, will follow up a tip about drug activity by going to the apartment of the purported offender, knocking on the door, and seeing what happens. If the occupants don't answer immediately and there are sounds which might be interpreted as people destroying contraband -- and just about any sound will do -- the police can knock down the door and search the apartment. If somebody does answer, the police can try to obtain consent, or perhaps observe something in "plain view" that entitles them to enter.
That's what they did in Winston, but the validity of the search wasn't the issue; whether Winston had the right to complain about it was. The evidence indicated that his girlfriend was the tenant, and that Winston stayed there overnight on a frequent basis, in violation of the housing authority's regulations. The trial court concluded that because Winston wasn't allowed to be a overnight guest, he wasn't, so he had no standing to contest the search. The 2nd District easily found the flaw in that reasoning, and reversed, in accord with the general law that an overnight guest does have a sufficient privacy interest in the premises to have standing to contest the search.
State v. Rogers begins with an identical fact situation -- project police get a tip of drug activity, and decide to do a knock-and-advise -- but with a twist: there's nobody home. At least not yet; while the officers were standing in front of Rogers' building after the second failed attempt, a car approached with darkly tinted windows, which was sufficient in the officers' view to warrant a stop. Rogers was a passenger, and started to exit the car, but was told to stay inside. After checking the ID's of the driver and Rogers, the police gave the driver a verbal warning and told her she was free to leave. Not Rogers; he was asked to step out of the vehicle. The officers told him of the drug complaint, and he gave a consent to search his apartment.
The consent would seem to obviate any problems with the search, but it doesn't. Back in State v. Robinette, the Supreme Court held that if a driver was stopped for a traffic violation, once the officer had completed the ticket, he couldn't ask the driver for consent to search the car. The same holds here, the court concludes: once the officers had finished their business at the vehicle, their asking Rogers to exit the car was an illegal detention, and any consent he gave was the product of that illegality. That's not a hard and fast rule; as the concurring opinion points out, "the taint of the illegal can be purged when the suspect's subsequent consent is the product of an intervening act of free will." That's up to the State to prove, though, and here the State didn't.
Perhaps the most interesting of the three cases is State v. Henry. The cops had planted a GPS device on Henry's car, sans warrant of course, and he was convicted on the basis of various evidence gathered as a result. Then the Supreme Court handed down US v. Jones last term, holding that a search warrant was required for that. The State argued that the good faith exception to the warrant clause applied, relying on Davis v. US. Davis was a passenger in a car, and was arrested and placed in a police cruiser; the cops then searched his jacket, which was in the car, and found a gun. That would have been a valid search under Belton v. New York, which was the law at the time, but a few months after Davis' conviction the Supreme Court reversed Belton in Arizona v. Gant. Davis sought to take advantage of that, but the Supreme Court held there was no purpose to applying the exclusionary rule to conduct which was legal at the time.
There's some sense to that, but the 2nd District points out that there were no judicial decisions in the 2nd District upholding the right of the police to place a GPS device on a car without a warrant, so there was no "binding judicial authority" the police could rely on to uphold the search.
There's another issue here, though. As I pointed out in my discussion of Jones when it came down, the main issue in the case was whether the placement of the device constituted a search. In the Supreme Court, the government argued that even if it was, the police had probable cause to place the device, and the necessity of a warrant was obviated by the automobile exception. The majority didn't address this argument, deeming it forfeited because the government had failed to raise it below. The same fate befalls the State here: they never argued the probable cause issue in the trial court, so the appellate panel declines to address it.
With the three decisions from the 2nd District last week, and two others the week before from the 9th on dog alerts (see discussion here and here), we've had five excellent 4th Amendment decisions. Let's hope that continues.


text:
John Braun, August 3, 2014, The Daily News
Washington Gov. Jay Inslee's announcement regarding Washington's water quality standards includes a dramatic proposal that raises many red flags for communities and families throughout the state.
There is consensus that it is time to update our water standards. No one is suggesting that we should do less to protect our environment, but the goal must be to balance cleaner water with protecting family budgets and jobs. What we don't need is another war on jobs with more uncertainty and threats of regulations that are impossible to measure or attain.
In addition to new rules on water quality standards, Gov. Inslee said that it was time to "take a broader approach to areas that are not currently regulated." He defined those areas as "up stream at the source," and that "the majority of toxins come from what we build."
What we build in Washington happens through big and small manufacturing companies that employ more than 300,000 people and contribute more than $26 billion a year to the state's economy. Many of these companies, such as Simpson Timber and PDM Steel in Cowlitz County, are the economic foundation and lifeblood for hundreds of communities throughout the state.
Fortunately, Washington already has some of the most stringent environmental protections in the nation, and our businesses and communities are committed to preserving our state's natural resources. However, these proposed regulations are overly burdensome and unrealistic.
The governor's proposal, called the Toxin Reduction package, includes giving the Department of Ecology expanded authority to ban certain chemicals and require companies to use new "green chemicals." The proposal also expands DOE's reach into local governments to force change through the permitting process and into areas not currently covered by permitting. The most serious consequence of the changes is that the science and technology don't even exist to comply with some of the new regulations, and the alternatives are too costly for many businesses to bear.
Banning certain chemicals or demanding that companies remove components when no alternatives exist makes the governor's retaliatory approach unworkable and harmful to our economic health. An annual $2,400 increase in utility bills would be devastating for working families across the state.
Given Gov. Inslee's actions, the red flags warn of far reaching impacts to our high-wage manufacturing jobs and potential increases in utility and sewer bills. The City of Bellingham predicts that, if Washington adopts water quality standards similar to Oregon, city sewer bills could increase from $35 up to $200 per month. This would impose a huge financial burden on low and middle-income families and households on fixed-incomes.
As chairman of the State Senate Trade and Economic Committee, I know that economic growth requires our state to effectively compete with other states and the world for jobs. Just look at the 20 states that jumped into the fierce competition for Boeing's 777X program. This does not mean that we should ignore water quality issues; but that our efforts should instead be focused on standards that are practical, measurable and attainable. The proposed regulations achieve none of those things and more likely will reduce our state's ability to compete for jobs and place a large burden on communities and families.
The governor wants to give unelected bureaucrats in the Department of Ecology more power and authority over how we build things in Washington. This is an enormous burden for smaller companies that are not equipped to deal with the costs. In the manufacturing sector, 52 percent of companies employ 20 or fewer people. How will they be impacted by these new regulations?
Many of us remember the spotted owl battles of the late 1980s. Communities in the crosshairs of that environmental battle have never recovered. Our mountains, lakes and streams are a large part of what makes living in Washington so wonderful but so are the high-wage jobs that support our families. Our goal must be to preserve and balance both.


text:
Download Red Barn Live Wallpaper apk 1.07 free for Android smartphone
Posted by Adermark Media in Personalization | Aug. 25, 2014 | 3 Comments
Apk file size: 5.3 MB
A red barn surrounded by flowers and trees. Sky is dynamic and changes colors and appearance for every second of the day. Horizontal scrolling supported on all devices.
Double tap on screen to rearrange flowers.
Most settings are locked in the free version. All settings are available in the full version including the dynamic real time mode.
Contributors (flickr users):
Barn: Valerie Everett
Dandelion Flower: Amanda Slater
Bluebell: Mark Fosh
Greater Stichwort: Graham J Shaw
Cowslip: Alex Brown
Geranium: Yola de Lusenet
Forest: U.S. Forest Service, Southwestern Region, Kaibab National Forest
Moon: Luis Argerich
Thanks everyone for the creative commons licenses!
Whats new
presets and saved settings
Adermark Media part of our Personalization and have average installs from 100 to 500. Last Update Aug. 25, 2014. Google play rating is 88.2353. Current verison is 1.07. Actual size 5.3 MB.
Similar applications
3 Comments
A Google User
Very nice I would like to see more customization and more backgrounds in all your lwps, but they are beautiful.
A Google User
Allyson This is awesome!!!! Love it!!!:)
A Google User
Fantastic. Thanks for listening. I luv it. Couldnt be better.


text:
Perineal massage
View Single Post
November 29th, 2009, 04:39 PM
Max n Meghan's Mom
Mega Super Mommy
Join Date: Aug 2008
Location: Gainesville, Florida
Posts: 3,607
I didn't with my first. He was 7 lb 10 oz and I had just minor tearing. The OB did a few stitches (I don't know how many I was holding my baby boy!!!) but she automatically numbed me first. I didn't really feel anything except for the needles to numb. It wasn't pleasant, but wasn't horrible either, especially after having a natural child birth. Plus they give you some wonderful ice packs (even if you don't tear) and some numbing cream to use there as well as take home.
Thank you for my beautiful siggy, *Kiliki*!
My Blog
Max n Meghan's Mom
View Public Profile
Find all posts by Max n Meghan's Mom


text:
ROCKSMITH "Letterman" Snapback Cap
Posted by Maui, February 14th, 2013 04:02 am under News
ROCKSMITH returns with a varisty feel. Their new "Letterman" snapback cap takes the wool elements of a varsity jacket and transform them into the six panel above and below your screen right now.
As shown, the front crown features a big Red "R" with 1993″ written inside in white. For the backdrop, you'll find a Navy Blue color and Red eyelets. A Red bill also tags along. If you life what you see, you can get yours today at http://www.rocksmithnyc.com/.


text:
This is a file from the Wikimedia Commons. Information from its description page there is shown below.
Commons is a freely licensed media file repository. You can help.
Deutsch: Lichttonorgel von Edwin Welte, Prospekt um 1936
English: Light-tone-Organ by Edwin Welte, from a 1936 prospectus
|1936 (Uploaded at 2011-10-26 04:36 (UTC))
|This is a retouched picture, which means that it has been digitally altered from its original version. Modifications: clipped Welte Lichtton Orgel. The original can be viewed here: Lichtorgel.jpg. Modifications made by clusternote.
|Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled GNU Free Documentation License.
http://www.gnu.org/copyleft/fdl.htmlGFDLGNU Free Documentation Licensetruetrue
The official position taken by the Wikimedia Foundation is that "faithful reproductions of two-dimensional public domain works of art are public domain, and that claims to the contrary represent an assault on the very concept of a public domain". For details, see Commons:When to use the PD-Art tag.
{{ PD-Art}} template without parameter: please specify why the underlying work is public domain in both the source country and the United States
(Usage: {{PD-Art|1=|deathyear=|country=|date=}}, where parameter #1 can be PD-old-auto, PD-old-auto-1923, PD-old-100 or similar)
|Public domainPublic domainfalsefalse
|This image (or other media file) is in the public domain because its copyright has expired.
This applies to Australia, the European Union and those countries with a copyright term of life of the author plus 70 years.
You must also include a United States public domain tag to indicate why this work is in the public domain in the United States. Note that a few countries have copyright terms longer than 70 years: Mexico has 100 years, Colombia has 80 years, and Guatemala and Samoa have 75 years, Russia has 74 years for some authors. This image may not be in the public domain in these countries, which moreover do not implement the rule of the shorter term. Côte d'Ivoire has a general copyright term of 99 years and Honduras has 75 years, but they do implement the rule of the shorter term.
File usage
|Horizontal resolution
|28.35 dpc
|Vertical resolution
|28.35 dpc
|File change date and time
|09:54, 22 October 2011
Find out more
SOS Childrens Villages aims to make Wikipedia suitable for young learners. By supporting vulnerable children right through to adulthood, SOS Children's Villages makes a lasting difference to the lives of thousands of people. Education is a key part of our work, and our schools provide high-quality teaching to the children in our care. You can help by sponsoring a child.


text:
I wanted to get some hip hop onto the baseball mixtape but felt like not using Nelly. Google led me to Natural Resource, a shortlived indie group from the 1990s. Good info on Natural Resource is scarce, but they were the launching point for eminently talented female artist named Jean Grae — then known as What? What? The best writeup I've seen on this song is from a blog called Twelve Inchers, who cite these lyrics and wonder if the track is really about baseball at all:
Baseball was never for blacks. (What?)
It used to be a pasttime for whites. (That's true.)
Now it has mad Puerto Ricans. (Uh oh)
But that's not the point of the song. (A-ight)
The point of this song, and I make it mad simple, when I be flippin' this script:
Is that the industry is all over the mound, pitchin', but nobody's makin' any hits.
Baseball is not just a sport
It's the verbal/mental/physical/spiritual/emotional level that we are on
It's about time that all you devils was gone…
What makes this song great, aside from being catchy and clever and all that stuff, is the way it kind of teases and flips the baseball metaphor. Sure, "I hit a lot of homeruns" can be a more interesting way to say "I record a lot of hit songs," but that's easy and a cliche (see, once again, Nelly). So Natural Resource acknowledges that. They even lay out some rhymes along those lines: "First batter up well here's the pitch that's a curve/Second batter up because the first got served" before subverting the whole notion. Baseball after all, is a deeply flawed institution, just like the music industry, where exploitation on class and racial lines can overshadow talent. Talent that a group like Natural Resource (or an old Negro Leaguer like, say, Cool Papa Bell) has but can't capitalize on for reasons beyond their control. You see a lot of baseball metaphors related to play on the field, but not too many based on the socio-economic dynamics and history of the game.


text:
During a work outing several years ago, my colleagues and I were given an opportunity to make ocarinas out of clay. While the others created instruments that looked like delightful sea creatures, dragons and other fictitious members of the animal kingdom, I suspiciously stared down at my lump of clay without coming up with a single idea. In the end, I created a simple, goofy smiley face on one side, and on the other, I wrote "My talents lie elsewhere", since when it comes to envisioning and creating my own piece of artwork, I'm utterly and unapologetically hopeless.
That's not to say that I don't love art however, for I do – it often brings me great joy. I can, quite happily, spend hours wandering aimlessly through art exhibitions and galleries, and the genre of naïve art (discovered after I visited a naïve art gallery in Tel Aviv for an article I was writing) seems to reach into my soul and make my heart race with emotion. It touches me in ways that I simply cannot describe. I love the colors, the detailed intricacies woven into every scene that invite me to stop in my tracks and stare in open-mouthed wonder…
And now I'm going to let you in on a little secret. When it comes to art, I am a hoarder. I'm not talking about works by Picasso, Matisse or other, lesser known artists. I'm not even referring to works of art created by adults. If you look among the stacks of papers piled on my bookshelves and shoved haphazardly in closets and drawers around my home, you'll find hundreds of drawings created by the local artist in residence – the boy who once believed (thanks to reading Norton Juster's "The Phantom Tollbooth" while learning the alphabet in second grade) that words grow on trees and letters can be found in everything, as long as you know how to look for them. How cool is that?
The "collection" contains scribbles from the early years, holiday-themed images, pictures of our family, various animals (many of which, are even identifiable) and so on. And aliens. Lots and lots of drawings of aliens – smiling, holding weapons and carrying out a veritable plethora of alien activities. I love the quirky creativity that frequently seems to find its way into his work, though sometimes I feel like I'm living in a gallery curated by a young Luke Skywalker…
With few exceptions (and despite my husband's pleas for me to be more, shall we say, discerning), I save them all. As an adult, I know how much I enjoy looking through the essays and school projects created by my younger self, and I like to imagine that the adult my son will eventually derive just as much pleasure from doing the same. He loves to draw and is surprisingly quite good at it – and I say "surprisingly" because as I mentioned previously, most of my own attempts at any form of visual art simply serve to reinforce the notion that I have no artistic skills whatsoever. My mother, on the other hand, is a gifted artist across a variety of platforms, so it would seem rather likely that her natural aptitude for drawing and the like skipped directly over me and went straight to my son.
Now don't get me wrong – I'm not jealous. I know I'm creative and that my talents really do lie elsewhere. I'm madly and passionately in love with words and writing. I've written poems while sitting on rocks in the desert, spent entire airplane flights to Europe writing in my ever-present writing notebook, hours in cafés writing whatever comes to mind… I have tens of notes in my phone listing potential opening lines of poetry and a veritable plethora of Word files containing everything from single lines to partially written poems to multiple versions of the same poem. So clearly, the creativity genes haven't completely passed me by. I also know and accept my limitations, so for the love of God and all that's holy, please don't torture me by asking me to create something with my hands.
But where was I? Oh, yes. My son's art. Isn't it great that he gets to attend a school where art is such an inherent part of the educational philosophy, so much so that even the notebooks (carefully crafted by our children and painstakingly glued together by their parents in that sticky, end-of-the-year bookmaking ritual) reflect the rich, colorful tapestry of knowledge imparted by their teachers? I delight in seeing the complexity increase from year to year, of seeing my son's dutifully copied renderings of his teacher's chalkboard drawings improve as his skill set grows – even more so when my attempts to mirror those same shapes (for I know better than to try to emulate anything more complicated than that) fall far short of the capabilities demonstrated by my nine-year-old.
As with the naïve art, my favorite aspect of Waldorf art would have to be the colors. I love the bursts of color that seem to leap out of every drawing and tease my soul, the mesmerizing blend of shades and hues that makes me want to write something that evokes an equal sense of beauty. I love the images and the abstract watercolors – so much so, in fact, that I even used one of my son's paintings as the background for my own website, poring over his creations until I found the one that moved me the most and matched the vision I was trying to create.
There is something in this imagery that draws me in like a warm embrace, colors dancing lazily across the page to capture my inspiration – which I surrender willingly, of course, for there are few sensations more blissful than allowing myself to follow a beckoning trail of color into the magical world of my son's imagination. And when it comes right down to it, that's really what it's all about, isn't it?
This entry was posted in Art, Childhood Memories, Daily life, Education, Family, My son the..., Parenting, Writing and tagged aliens, ART, Education, Family, naive art, Waldorf by Liza Rosenberg