{'fraction_non_alphanumeric': 0.03800569423293385, 'fraction_numerical': 0.015791564589816592, 'mean_word_length': 5.515746333045729, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Effectiveness of interventions for people bereaved through suicide: a systematic review of controlled studies of grief, psychosocial and suicide-related outcomes

Background Suicide bereavement is a risk factor for adverse outcomes related to grief, social functioning, mental health and suicidal behaviour. Consequently, suicide bereavement support (i.e., postvention) has been identified as an important suicide prevention strategy. However, little is known about its effectiveness. To redress this gap, this review aimed to assess the evidence of effectiveness of interventions for people bereaved by suicide, and appraise the quality of the research in this field. Methods We conducted a systematic review according to PRISMA guidelines. Searches of peer-reviewed literature in Medline, PsycINFO, Embase and EBM Reviews identified 12 papers reporting on 11 relevant studies conducted between 1984 and 2018. Results Across studies, there was a wide variety of intervention modalities, study populations, control groups, and grief, psychosocial and suicide-related outcome measures. Overall, the quality of studies was weak. While there was some evidence of the effectiveness of interventions for uncomplicated grief, evidence of the effectiveness of complicated grief interventions was lacking. Based on this scant evidence, interventions which seem to show promise include supportive, therapeutic and educational approaches, involve the social environment of the bereaved, and comprise a series of sessions led by trained facilitators. Conclusions There is a clear need for additional methodologically sound studies in this area. Specifically, selection procedures, sample sizes, randomization, and the use of appropriate measures are crucial. As people bereaved by suicide are at-risk of adverse grief, mental ill-health and suicidal behaviour, further research across the life-span is essential to prevent grief and mental health ramifications.


Background
Suicide constitutes a major public health problem with more than 800,000 people dying by suicide globally each year [1]. The societal toll of suicide goes well beyond the human loss. Whereas the act of suicide ends the pain of one, it is a major disruptive and psychosocial stressor for others who are bereaved [2]. A suicide death can affect a substantial number of people. For example, Berman [3] found that one suicide can affect between five nuclear family members and 80 relatives, friends and acquaintances. A recent meta-analysis of population-based studies found that approximately one in 20 people (4.3%) have experienced a suicide in one year, and one in five (21.8%) have done so during their lifetime [4].
Grief is understood as the primarily emotional (affective) and natural reaction to the loss of a significant other [5]. It encompasses diverse psychological (emotional, cognitive), physical, and behavioural responses to the death. Acute grief reactions include sadness, crying, yearning, guilt and anger [5]. The course and duration of the grief process after a suicide death appear to be similar to grief processes following deaths by other causes [6,7]. Nonetheless, people bereaved by suicide may experience more shock or trauma related to the unexpected or violent nature of the death compared to other forms of bereavement [7]. They may also experience more feelings of abandonment, rejection, shame, struggles with meaning-making and 'why'-questions, and less social support [8,9].
Suicide bereavement is also a risk factor for adverse outcomes related to complicated grief [10]. While consensus is emerging about the diagnostic criteria and the name of the syndrome (Prolonged Grief Disorder will be included in ICD-11), it is expressed through persisting characteristics of acute grief, and is more likely to occur after a sudden or violent death [11]. While there may be similarities between some clinical characteristics of complicated grief, depression and posttraumatic stress disorder (PTSD), there are a number of specific symptoms (i.e., maladaptive reactions) of complicated grief such as intense longing for the deceased, ruminative thoughts or images about the deceased, intense feelings of anger and guilt, avoidance of situations, people and places that remind of the deceased, and difficulty finding meaning in life [12,13].
Compared with the general population, people bereaved by suicide have a higher risk of suicidal behaviour, and psychiatric problems such as depression, anxiety, post-traumatic stress disorder, and substance abuse [8,14]. This is particularly the case for those who have a personal or family history of mental health and suicidal behaviour [15,16]. There is also growing evidence of increased physical disorders among people bereaved by suicide, possibly related to increased unhealthy lifestyles (e.g., poor diet, smoking) after the bereavement [16][17][18].
More than four decades ago, Shneidman [19] identified provision of adequate suicide bereavement support (i.e., postvention) as a major public and mental health challenge. Currently there seems to be a tension between the need for psychosocial and professional support reported by people bereaved by suicide [20][21][22][23] and what is known about its effectiveness [24][25][26]. At the same time, postvention has become available in an increasing number of countries [27], and has been recognized as an important suicide prevention strategy [1]. There has also been an increase in suicide bereavement research [28][29][30]. However, most of the research has been focused on the experiences of those who have been bereaved and the characteristics of suicide bereavement, whereas the effectiveness of postvention in terms of its impact on the grief process and mental health of bereaved individuals remains unclear [8].
To date three systematic reviews of interventions for people bereaved by suicide have been published [24][25][26].
McDaid et al. [24] identified eight controlled studies of grief and psychosocial interventions, delivered mostly in a family or group context. Six interventions showed some evidence of effectiveness on at least one outcome measure, such as reduced anxiety or depression, and less maladaptive grief reactions. Szumilas and Kutcher [25] reviewed sixteen postvention programs, including school-based, community-based and family-focused interventions. Although some of the reviewed interventions had positive impact on mental health and grief outcomes, the review found no evidence of reduced incidence of non-fatal or fatal suicidal behaviour related to any of the programs. Linde et al. [26] reported on seven group and individual intervention studies specifically in the context of griefrelated outcomes, encompassing complicated grief, uncomplicated grief and suicide-specific aspects of grief, such as guilt, responsibility and rejection. Five studies demonstrated a decrease of intensity of grief on at least one measure.
The three systematic reviews conducted to-date found some evidence of effectiveness of postvention interventions [24][25][26]. They also pointed out the limitations of the field, namely the paucity of intervention research in postvention, the diversity of methodologies used, and the general poor quality of the relevant studies. However, the systematic reviews used different inclusion and exclusion criteria and reported on different outcomes, ranging from a variety of grief and mental health outcomes [24] to grief-specific outcomes [26]. In addition, although McDaid et al. [24] focused on controlled studies only, including randomized controlled trials (RCTs), Szumilas and Kutcher [25] applied a wide perspective and included both controlled and uncontrolled studies, and a recent review by Linde et al. [26] also included an uncontrolled study. The differences between these reviews (i.e., broad criteria regarding study design or narrow criteria regarding outcomes) make it difficult to draw conclusions about the effectiveness of interventions for people bereaved by suicide.
To redress this gap in the literature and postvention practice, this review aimed to establish the effectiveness of suicide bereavement interventions with regard to grief, psychosocial (related to mental health and psychological functioning) and suicide-related outcomes using data from controlled studies only. The review was designed to (1) uncover the research findings regarding the effectiveness of interventions on grief, psychosocial and suicide-related outcomes, (2) assess the quality of the included studies, and (3) consider the implications for practice and further research. The findings of this review will provide crucial information for service providers, both professional and peer support-based, and policy makers, as well as for the bereaved by suicide in need of effective support.

Method
The review was conducted following the PRISMA guidelines [31], with systematic searches of the following databases: Medline, PsycINFO, Embase, and EBM Reviews, accessed through Ovid. Medline was searched with a combination of MeSH and text words: ( The search was undertaken in August 2018 and was not limited by language or date of publication. Three researchers (KA, KK, NH) independently assessed titles and abstracts for eligibility. Any disagreement was resolved through discussion. Potentially relevant studies were examined against the inclusion/exclusion criteria. The references of retrieved papers and existing reviews were hand searched to identify additional studies. Figure 1 presents the search and selection process.

Inclusion and exclusion criteria
The following inclusion criteria were used: (1) study population consists of people bereaved by suicide, (2) study provides empirical data on grief, mental health and/or suicide-related (i.e., suicidal ideation and/or (non-)fatal suicidal behavior) outcomes, (3) study involves a controlled intervention, and (4) study is published as a paper in a peer-reviewed journal. The review excluded: (1) studies not providing data specifically on people bereaved by suicide, (2) studies not providing data on grief, mental health and/or suicide-related outcomes, (3) studies without a control group, (4) case studies, and (5) review papers.

Data extraction
Three researchers (KA, KK, NH) independently extracted the following data from the selected studies: author, year and location (country), study design, eligibility criteria, sample size, participants' age and sex distribution, participants' time since the bereavement and relationship to the deceased, type (individual, family, group), characteristics and duration of the intervention, outcome

Quality assessment
The methodological quality of the included studies was assessed with the Quality Assessment Tool for Quantitative Studies [32]. No qualitative study met the inclusion criteria. The instrument comprises six components (selection bias, study design, confounders, blinding, data collection methods, and withdrawals and dropouts) to be scored as weak, moderate or strong. The total rating of a study was 'strong' if none of its components were rated 'weak'. A study was rated 'moderate' if only one of its components was rated 'weak' , and received a total rating of 'weak' if two or more of its components were rated as 'weak' [32]. In addition, the instrument assesses the integrity of the intervention and analyses (e.g., analysis by intention to treat status). Two researchers (KK, NH) independently assessed the quality of the included studies. Discussion with a third researcher (KA) and the wider team resolved any disagreement.
Most studies involved interventions that targeted adult populations, but three tested interventions aimed at children or adolescents [38,39,43]. A few studies included participants aged 65+ (e.g., Zisook et al. [40]), but no study specifically involved interventions targeting older adults. The percentage of females in the intervention samples ranged from 59 to 82%. Studies varied in terms of the types of participants targeted. Some focused on those with specific relationships with the deceased, such as parents [38] or spouses [35], and some had a broader focus on 'significant others' (e.g., Wittouck et al. [44]). The time since the bereavement varied across studies, with some reporting a few days [43] and others several years (Zisook et al. [40] report M = 3.9 years in the suicide bereaved sample). However, about half of the studies reported either a time range or a mean within or just over one year since the bereavement [35,37,38,41,42,44].
Six studies tested the effectiveness of a group intervention [33][34][35][36]39], including a group/school-based intervention [43]. Three studies evaluated family-oriented interventions [38,41,42,44], and two examined individual interventions [37,40]. The group, family and individual interventions applied supportive, psychotherapeutic and psycho-educational approaches, involving interactions and exchange with peers and/or professionals. One intervention was based on an individual writing task but also involved interaction with the researchers [37]. The duration of the intervention varied from one session in one study [43] to a series of 16 therapeutic sessions delivered over 20 weeks in another [40]. Several studies involved manualised interventions [37,38,[40][41][42]. As presented in Table 1, studies also varied in terms of the outcomes they assessed, and how they assessed them. Some studies assessed grief, using measures like the Inventory of Traumatic Grief [45], the Grief Cognitions Questionnaire [46], and the Grief Experience Inventory [47]. Other studies assessed mental health outcomes like levels of depressive symptoms (Beck Depression Inventory [48], Centre for Epidemiological Studies Depression Scale [49]), psychological distress (Brief Symptom Inventory [50]) or social adjustment (Social Adjustment Scale [51]). Still other studies assessed suicide-related outcomes, using measures like the Columbia Suicide Severity Rating Scale [52]. Table 2 details the methodological quality of the studies according to the six components of the Quality Assessment Tool for Quantitative Studies [32]. The overall study quality was weak: nine studies received a total rating of 'weak'; the other two [37,38] were rated 'moderate'. Looking at the rating in detail, three studies [34,41,42,44] were rated 'strong' on four components, and four studies [35,[38][39][40] were rated 'strong' on three components. Across studies, selection bias, blinding, and withdrawals and dropouts, were the weakest components. Seven studies used a randomized design; however, only one applied an intention-to-treat analysis [41,42]. Also, whilst studies applied valid and reliable measures, it is unknown if studies controlled for effects of other treatments (e.g., by a family doctor) which participants might have been receiving.

Grief outcomes
One study comparing an intervention with a passive control group provided some evidence of positive effects on grief outcomes. An 8-week support group program facilitated by a mental health professional and a trained volunteer found a greater decrease in grief feelings in the intervention group than in the control group [36].
Six studies with an active control group or a treatmentas-usual condition reported mixed findings. De Groot et al. [41] found no differences between a 4-session   family-based psychotherapy and treatment-as-usual on measures of complicated grief, although there was a trend towards reduced maladaptive grief reaction and perceptions of being to blame for the death. A secondary analysis of the same sample comparing participants with suicidal ideation with those who reported no ideation found a non-significant decrease in complicated grief in the former group [42]. Wittouck et al. [44] assessed the effectiveness of an intervention based on cognitive-behavioral therapy (CBT) and psycho-education, using complicated grief as the outcome. Although grief reduced in the intervention group, no differences were found on the development of complicated grief eight months after the intervention. Zisook et al. [40] compared the effectiveness of antidepressant medication alone or in combination with complicated grief therapy for different groups of bereaved (bereaved by suicide, by accident/ homicide, by natural causes). Complicated grief therapy resulted in similar reduction of complicated grief symptoms in the three bereaved samples, though the sample sizes may have been too small for detecting statistically significant differences [40].
A study comparing effects of a professionally led group psychotherapy and a social group program for widows bereaved through suicide [34,35] found that grief symptoms reduced in the therapy group [34], although a repetition of the study with a larger sample failed to replicate this effect [35]. A study comparing the effects of a death-related writing task intervention with a control condition involving trivial writing tasks yielded mixed findings [37]. Both groups experienced a significant reduction in grief levels, but the suicide-related grief aspects were more reduced in the intervention group than in the control group [37].

Psychosocial outcomes
Three studies with passive control groups focused on psychosocial outcomes, such as depression, anxiety, selfefficacy, social acceptance, and alcohol and drug use, in young people bereaved through suicide. Pfeffer et al. [38] demonstrated that a 10-week psychologist-facilitated group therapy program for children reduced anxiety and depression but not post-traumatic stress of social adjustment at 12-weeks follow-up. A psycho-educational component for parents may have contributed to the positive effects. It is worth noting, however, that there was significant attrition in the control group and follow-up beyond 12 weeks was not included. Sandor et al. [39] reported the effects of a series of three church-based support meetings following a suicide in the community. Modest positive effects were found in the intervention group in terms of greater self-efficacy, social acceptance and job competency, up to two months after the intervention. No effect on internalization, externalization, depression, risk behavior or drug and alcohol consumption was found in the only school-based intervention included in the current review [43].
Studies assessing the effects of an intervention for adults against an active control group found little evidence of effectiveness regarding psychosocial outcomes, including depression, distress, problem solving, and social adjustment. Participants in a weekly, 4-month, support group program with an educational component reported less painful emotions, and more positive emotions, insights, and problem-solving skills compared to non-help-seeking people bereaved by suicide and help-seeking individuals in psychotherapy [33]. However, a suicide and an attempted suicide occurred in the intervention group, and the study quality is unclear. The above-mentioned study by Constantino and Bricker [34] also looked at depression, distress and social adjustment and found significant reduction in depression and distress in both groups, whereas social adjustment improved in the social group only [34]. However, a repetition of the study with a larger sample did not find any difference between the two groups [35]. A study assessing the effects of an intervention based on CBT and psycho-education on complicated grief found reduced depression and passive coping styles in the intervention group, although no differences were found regarding depression at eight-month follow-up [44].

Suicide-related outcomes
No study reported on non-fatal or fatal suicidal behaviour, still, three previously mentioned studies reported on suicidal ideation as an intervention outcome. Wittouck et al. [44] found no statistically significant differences between study groups regarding suicidal ideation either immediately after completion of therapy or eight months post intervention. De Groot et al. [41] found no differences between family-based psychotherapy and treatment-as-usual on measures of suicidal ideation. However, Zisook et al. [40] found that complicated grief therapy resulted in a significant reduction in suicidal ideation in participants bereaved through suicide.

Discussion
This systematic review aimed to establish the evidence for the effectiveness of suicide bereavement interventions. Unlike previous reviews, it only included controlled studies, and reported on grief, psychosocial and suicide-related outcomes. Despite a substantial increase in suicide bereavement research over the last decades [29,30] the search identified only 12 papers, reporting on 11 studies, published over 35 years (1984-2018). Almost three quarters of the studies (8 out of 11 studies) were conducted in the USA, and the remaining three in Western Europe. It is not clear whether their results would be replicated in other cultural settings and (mental) health care systems [53]. None of the studies particularly addressed interventions for people aged 65+, although there is some evidence that elderly suicide survivors may experience unique challenges while coping with their loss [54]. Most intervention studies included more female participants than male participants. As there are gender differences in the experience of suicide loss and coping strategies between females and males [55], the unintended focus on effectiveness of interventions in female-dominated samples [56] creates a significant gap in the literature and postvention practice.
Studies identified in this review examined a wide range of outcomes related to grief, psychosocial functioning, and suicidal ideation. Given the diversity of outcomes across studies, the wide range of measures employed, and the methodological limitations, at this stage it is not possible to univocally indicate effective interventions targeting issues related to bereavement through suicide. Two studies that tested CBT-based interventions targeting complicated grief, such as an intervention with psycho-education [44] and targeted complicated grief therapy [40], yielded some positive short-term results. Nonetheless, De Groot et al. [41] in a study of a family CBT grief counseling program did not report lower levels of complicated grief. Similarly, other intervention studies reporting on grief reactions in general indicated some inconsistent positive results regarding broadly defined self-reported grief feelings [36], grief symptoms measured by the Grief Experience Inventory [34,35,47], and the Grief Recovery Questions [37,57]. This lack of evidence regarding effective grief interventions (as well as evidence of lack of effectiveness) for suicide survivors is concerning given their susceptibility to complicated grief reactions [10], and more suicide-specific reactions, such as feelings of rejection and struggles with 'why'-questions [7][8][9].
Despite research findings indicating increased risk of suicidal ideation and behaviour among people bereaved through suicide [8,14,16], only three studies identified in the review looked at a suicide-related outcome, which was suicidal ideation. Of interest, these three studies were relatively recent RCTs and evaluated effectiveness of a CBT-based psychotherapy intervention [40,41,44]. Again, results were mixed, as only Zisook et al. [40] reported a significant reduction in suicidal ideation in both the suicide bereaved and the non-suicide bereaved groups. None of the reviewed studies looked at suicidal behaviour as an outcome. This may be related to relatively short intervention follow-up periods, statistical rarity of non-fatal and fatal suicidal behavior among the bereaved by suicide [16], and relatively small sample sizes [7,8].
All reviewed studies reported on effectiveness of interventions in terms of various psychosocial outcomes, such as depression and/or anxiety [e.g., 34,38], posttraumatic stress [38], distress and social adjustment [34], self-efficacy [39], problem solving [33], and substance use [43]. Particular interventions were related to particular positive outcomes, e.g., a group therapy for children [38], CBT-based psycho-educational intervention [44], and group psychotherapy for widows [34], found significant reductions in depression. Nonetheless, the diversity of intervention settings, populations and measures used, along with very limited replicability of effectiveness studies, limit conclusions and implications for postvention practice. Again, this is concerning in the light of possible negative grief, mental health, and suicide-related sequelae of suicide loss [8,16] and support needs of the bereaved [21].

Factors affecting effectiveness of interventions
Of the interventions with a passive control group, effective interventions [36,38] were delivered over time (eight and 10 weeks respectively). Both interventions were provided by trained facilitators (trained volunteer and clinician, and clinicians only, respectively), and included supportive, therapeutic and educational aspects. The use of manuals or guidelines may help guiding the intervention [37,38,[40][41][42]. Involving parents [38], or the wider community [39] may contribute to the effectiveness. A common factor in the effective studies comparing different interventions (involving an active control group) is the finding that grief-specific interventions may yield stronger effects on grief outcomes compared to interventions targeting other outcomes [34,37], though other studies failed to find such an effect [35]. The ineffective interventions with a passive comparator [43,44] comprised shorter interventions (one and four sessions, respectively), and focused on complicated grief [44]. Other RCTs [40,41] also failed to find positive effects on complicated grief outcomes. In addition, psychosocial characteristics of the bereaved who enter psychotherapy or other grief interventions may impact effectiveness of an intervention. For instance, De Groot et al. [42] found that participants who reported suicidal ideation benefited more from a family-based psychotherapy intervention in terms of both reduced risk of maladaptive grief reactions and lowered suicidality, than participants without suicidal ideation.

Limitations
Despite extensive systematic searches the review included 12 papers reporting on 11 studies only. Overall, the quality of the studies is weak, especially with regard to selection bias, blinding, and withdrawals and dropouts. Assessing the quality of studies published before 1998 was particularly difficult as the articles did not provide information required to address quality criteria listed in the Quality Assessment Tool for Quantitative Studies [32] used in this review. Also, some of the newer studies did not report on all the quality criteria. In both scenarios, this resulted in ratings of 'weak' on those components, and it is possible that the overall study quality was higher than reported in the publications. This observation points out that the quality of the reporting of the intervention studies remains a concern.
Implications Due to the limited number and relatively modest quality of the studies the implications for practice are not robust. This finding is particularly concerning from the point of view of clinical and community postvention practice. Despite five decades of research there is still a lack of evidence as to which interventions are effective for suicide bereavement and its associated outcomes, including complicated grief. It also remains unclear which intervention modalities delivered in particular settings, such as schools [43], participants' own homes [41,44] or clinical settings [40], are most helpful for suicide survivors across a range of age, gender and/or national/cultural groups. Initiatives, such as the Core Outcome Measures in Effectiveness Trials [58] and the International Consortium for Health Outcomes Measurement [59], support development of an agreed set of standardized outcome measures or "core outcome sets", for particular (mental) health conditions. Development of a "core outcome set" for suicide bereavement interventions could facilitate collection and reporting of comparable effectiveness data, thus addressing heterogeneity of outcomes and measures reported in this systematic review.
Still, the review identified crucial information for service providers and bereaved individuals seeking support. Suicide grief interventions need to include a sufficient number of sessions over a sufficient length in time. Interventions should include supportive, therapeutic and educational aspects, and must be led by trained facilitators, who may benefit from the usage of manuals. Involving the social environment of the bereaved individuals may contribute to the effectiveness. Future research should focus on grief and complicated grief interventions of sufficient duration. Selection procedures, sample sizes, randomization and blinding need specific attention. Appropriate measures of grief, complicated grief and mental health should be applied. Both short-term (e.g., post-intervention) and long-term follow-up (e.g., several months) should be assessed. Also, echoing a recommendation formulated a decade ago [24], qualitative research, currently lacking, may increase our understanding of how the bereaved experience the interventions, and what they find helpful or not. Future research should pay equal attention to males and females, and to interventions in different age groups, especially with regard to bereaved older adults, an age group currently overlooked.

Conclusions
This systematic review found scant evidence of effectiveness of suicide grief interventions. Whereas there is some evidence of effectiveness of general suicide grief interventions, evidence of the effectiveness of complicated grief interventions after suicide is lacking. There is a clear need for the methodologically sound conducting and reporting of controlled studies across the life-span. Further research is essential to prevent adverse grief, mental health ramifications and suicidal behaviour in people bereaved by suicide.