{'fraction_non_alphanumeric': 0.03134764470417349, 'fraction_numerical': 0.016214298984917323, 'mean_word_length': 5.290692732681683, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 9, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
The application of soft systems thinking in SDG interaction studies: a comparison between SDG interactions at national and subnational levels in Colombia

Since the approval of the Agenda 2030, researchers and policy makers have pointed out the need to understand interactions among the Sustainable Development Goals (SDGs)—suggesting that progress or the lack of progress toward one goal will affect other goals through systemic interactions, producing synergies and trade-offs. However, most of the methods used to account for these interactions rely on hard systems thinking approaches, which are limited by the absence of needed data below national levels. Moreover, a general lack of data also constrains the scope of analysis to the 17 Goals, ignoring their 169 underlying targets. Given these challenges, we report on an experiment using an example of a soft systems thinking methodology: the SDG Synergies approach, which is based not only on available information but also on the elicitation of stakeholder and expert opinions. Thus, the approach allows for analysis of target-to-target interactions at subnational scales. The study, the first of its kind, assessed interactions at two scales: the national level in Colombia and the subnational level in the department of Antioquia. The results reveal profound differences between the two scales, suggesting that national-scale analysis of SDG interlinkages is not certain to capture local-level realities. The findings raise important issues for understanding and managing cross-scale interactions. Our work suggests that soft systems thinking is more appropriate for assessing SDG interactions because such an approach lends itself to conducting target-level analysis at various scales in the face of limited data availability.


Introduction
The Sustainable Development Goals (SDGs) include a set of 169 targets grouped within 17 goals adopted by the United Nations General Assembly to address the significant socioenvironmental challenges facing the world (UN, 2016). As the name suggests, the 2030 Agenda for Sustainable Development aspires to make these goals and targets a reality by 2030. Moreover, the SDGs constitute an "integrated and indivisible" strategy, within which the accomplishment of every goal and target must transpire before sustainable development truly occurs (UN, 2016). The primary challenge facing those working toward this future concerns making decisions today that properly orient development trajectories toward realizing this aspiration.
Since the approval of the 2030 Agenda, researchers and practitioners have pointed out the need to understand interactions between its goals and targets. This implies that changes in terms of one goal or target will potentially affect other goals or targets through systemic interactions-with some targets interacting negatively, producing trade-offs, and others interacting positively, creating synergies (Weitz et al., 2018). The implication is that the tenets of analysis of interconnected systems should apply to efforts to implement Agenda 2030. This interconnected approach significantly complicates policymaking, as the orientation of development trajectories over the coming decade would need to consider possible trade-offs and synergies between SDGs, and related policies and plans, to ensure policy coherence, thus respecting the Agenda's integrated and indivisible nature (Nilsson & Weitz, 2019;Weitz et al., 2018).
In fact, many countries have begun to orient their development efforts towards the 2030 Agenda (UN, 2019). At the same time, however, scientists and international institutions are still calling for governments to strengthen their strategies to achieve policy coherence for the SDGs (Breu et al., 2020;Nilsson & Weitz, 2019;OECD, 2019). As such, there is a need to use science-based approaches to enhance technical capacity to address possible interactions in the implementation of the Agenda (Allen et al., 2018;Sospedra & Martin, 2005). In response, since 2015, enough research has been published to motivate a paper reviewing the state of the art of SDG interactions-oriented literature (Bennich et al., 2020). In this review, most published articles report on the development of conceptual models of SDG interactions derived from "relevant" issued literature. However, the published research documenting specific SDG interactions and in different contexts is extremely limited . Most often, the cited literature does not specifically target the 2030 Agenda, but rather documents relationships that can be understood as synergies (e.g., access to electricity increases time spent studying) or trade-offs (e.g., increased generation of hydropower leads to the degradation of downstream aquatic ecosystems). The construction of conceptual models of specific SDG interactions, therefore, requires a mental mapping of each cited interaction onto SDGs interlinkages. This complicates standardization and, therefore, generalizability.
Other recent publications report on the application of predictive models to simulate the future co-evolution of socioeconomic indicators pegged to specific SDGs, based on the observed evolution of these indicators through time (e.g., Collste et al., 2017;Dörgo et al., 2018;Ospina-Forero et al., 2020;Pradhan et al., 2017;Spaiser et al., 2017). We identify these methods as hard systems thinking approaches, as they seek to quantify interlinkages based on quantitative models of causation within SDG interactions and derived from observed spillover effects. Proponents of these approaches argue for their replicability in that they discover potential interactions within publicly available data (e.g., Guerrero & 1 3 Ospina-Forero et al., 2020). Most commonly, however, these methods rely on time series of development indicators that are only available at the country level, which limits the scope of these studies to the national scale. Moreover, the data used typically serve as proxies for the 17 broad goals, rather than for the 169 specific targets.
The application of hard systems thinking methods implies two things. First, that aggregate patterns of national-level progress related to SDG goals reasonably represent patterns of subnational development. Second, that progress associated with an overall goal implies equivalent progress in terms of each specific target within this goal. However, many authors argue that the nature of SDG interactions will vary significantly based on local contexts and realities (Jiménez-Aceituno et al., 2020;Reed et al., 2015;Stephens et al., 2018). If true, it logically follows that subnational target-to-target interactions must be accounted for and handled to achieve policy coherence in terms of 2030 Agenda implementation (Nilsson & Weitz, 2019;Weitz et al., 2018).
Nonetheless, most published SDG interaction studies, whether focused on literatureinformed conceptual models or indicator-informed quantitative models, do not apply to specific subnational target-to-target analyses (see Bennich et al., 2020). The proliferation of these methods has created a gap in the literature accounting for subnational target-totarget SDG interactions. Additionally, as Jiménez-Aceituno et al. (2020) noted, there are few studies comparing subnational interlinkages with national-scale interactions.
Therefore, in this paper, we report on an experiment designed to assess potential interactions between specific SDG targets as defined at the national level in Colombia and at the subnational level in the department of Antioquia. Given the challenges associated with applying hard systems thinking approaches to specific target-to-target interactions at the subnational scale, we deployed an approach we consider to be consistent with soft systems thinking: cross-impact analysis tailored for SDG analysis (Weitz et al., 2018). Henceforth, we refer to this as the "SDG Synergies approach." In contrast to hard systems thinking methods, the SDG Synergies approach characterizes interactions based on elicitation of stakeholder/expert opinion-breaking the dependence on unstandardized published literature and unavailable subnational socioeconomic indicators.
This study is the first of its kind in Colombia, and it tackles head-on the question of how the nature of SDG interactions changes when studied at national or subnational levels. This approach allowed us to explore assertions by prior researchers (Jiménez-Aceituno et al., 2020;Reed et al., 2015;Stephens et al., 2018) that the nature of SDG interactions will vary significantly based on local contexts and realities; indeed, our work with this example confirms their assertions.
Finally, having carried out the experiment, we address the question of whether our soft systems thinking approach merits deployment-even if the information required for applying a hard systems thinking approach is readily available. To tackle this question, we present some theoretical aspects of the hard vs. soft systems debate. Our understanding of this debate leads us to argue that soft systems thinking approaches to characterizing the nature of SDG interactions are preferred regardless of the scale of analysis. We present this argument in favor of soft systems thinking approaches first to better support the methodology and results of the actual experiment.
The rest of the paper is structured as follows: Sect. 2 presents a literature review. Section 3 explains the methodology. Section 4 presents and compares the findings from both experiments. Section 5 discusses the implications of the results. Section 6 concludes.

A primer on soft systems thinking, and its critique of hard systems thinking
The distinction between hard and soft systems thinking can be traced back to Peter Checkland's development of the Soft Systems Methodology (SSM) in the 1970s (Checkland & Scholes, 1999). Checkland and other Operational Research (OR) researchers began questioning the theoretical foundation of using hard systems thinking to study social reality (e.g., Checkland, 1978;Ross & Hoos, 1974;Shelly, 1965;Tyler, 1979;Voigt, 2011). These authors argued that, while quantitative approaches are appropriate for the study of wellstructured systems, such approaches are inadequate for analyzing systems with substantial human components (Michael C. Jackson, 1985).
This critique rested on the argument that human systems are subjective, ambiguous, and ill-structured, devoid of an objective reality endowed with universal mechanisms of causation/correlation that can be theorized and tested (M. Yolles, 1996;M. I. Yolles2020). In response, some OR researchers began to apply the interpretive/subjective social science paradigm that the social world is made up of people's distinct concepts, constructs, and intentions, and that, therefore, no universal social structures or objects can be observed independently (M. C. Jackson, 1982;Mingers, 1984;Zexian & Xuhui, 2010). This discourse promoted Checkland to develop an alternative: the SSM. He differentiated SSM from hard systems thinking by arguing that: "None of these approaches [hard systems thinking methods] pays attention to the existence of conflicting worldviews, something which characterizes all social interactions […] In SSM the (social) world is taken to be very complex, problematical, mysterious, characterized by clashes of worldview […] our process of inquiry into it, can itself be organized as a learning system. […] This shift created 'soft' as opposed to hard systems thinking" (Checkland, 1989a).
In developing this learning paradigm, where human systems are continuously constructed and shaped by the various "worldviews" (Checkland, 1989b) of the people within them, Checkland drew heavily on the prior philosophical work of Sir Geoffrey Vickers, who coined the term "appreciative systems" to refer to the systemic nature of human thinking (Vickers, 2018). According to Vickers, each person possesses a unique set of beliefs and moral standards, forming an appreciative system that shapes his or her perception of reality. Everyone has a distinct appreciative system based on the social reality that each person inhabits, perceives with his or her senses, and communicates to the rest of society. Each person's appreciative system dictates the actions in which he or she chooses to intervene. According to Vickers, this new intervened reality is again observed and interpreted, potentially changing that person's appreciative system. This cyclic process is repeated over and over, dictating how the social world is dynamically constructed. Recognizing that such a dynamic would be difficult to model from a hard systems thinking perspective, Checkland offered SSM as an alternative.
To position SSM, Checkland could not ignore that hard systems thinking models applied to human systems had been "validated" through different theoretical mechanisms (see Barlas, 1996;Oreskes, 1998). In response, Checkland and other OR researchers warned that any correspondence between the model's predictions and what is observed in reality could be explained by the existence of compulsion imposed by the structures of power and authority within human systems (Michael C. Jackson, 1985;Mike C. Jackson, 2001;Thomas & Lockett, 1991). As Jackson (1985) says, "Because of the existence of autocratic decision-makers, the theory or model of social reality advocated by the analyst can 1 3 be imposed upon other interests in the system -enabling those decision-makers to better predict and control the workings of the system." In other words, the appreciative systems of the actors exercising the most power, quite probably, determine the casual mechanisms that validated hard systems thinking methods seem to capture. Hard systems thinking advocates interpret these casual links as an objective social structure, which they then use to create a model. In turn, the decision-makers that exercise power can use the model to legitimize their actions, producing the outcome that the model predicts.
This is precisely what Checkland sought to avoid when he proposed SSM: "[…] we were thereafter thinking of systems models not as descriptions of something in the real world but simply as devices to organize a debate about 'change to bring about improvement'. That was the key step in finding our way to SSM." (Checkland, 1989a). For Checkland, the only validation pursued in human systems modeling emerges internally, through consensus among the actors in the system (Checkland, 1995). The core idea behind SSM is facilitating dialogue among the various actors in a system, so that people's worldviews are changed "through the eyes of another" (Banathy, 1967). In this way, decisions are reached jointly, and the structures of authority are debated and transformed (Michael C. Jackson, 1985). Echoing this argument, we believe that Checkland's work offers key insights to propose using soft systems thinking in the implementation of the 2030 Agenda. Moreover, the discussion proposed by Checkland provides theoretical grounds to confront the inclination in some policy circles to apply hard systems thinking in the implementation of the 2030 Agenda.

Implications for the implementation of the interconnected 2030 Agenda
We argue that the Agenda itself rests upon a set of three postulates. First, the world, defined by its current systems of power, authority, and bureaucracy, is not on a path towards sustainable development, hence the need for the Agenda. Second, sustainable development cannot be achieved by making progress in one area while conditions fail to improve or deteriorate in another, hence the assertion that the Agenda is "integrated and indivisible." Finally, existing inequities and power imbalances cannot be part of a sustainable future, hence the pledge to "leave no one behind" in implementing the Agenda.
If these postulates are true, they echo SSM's "change to bring about improvement" foundations, calling into question any effort to apply hard systems thinking to issues of interactions within the Agenda itself. Any insights revealed through the application of hard systems thinking approaches likely reflect the mechanisms of power, authority, and bureaucracy in a given country-not objective, context-independent truths of how the SDGs have interacted in the past, or should interact in the future. This distinction is essential because, if we confuse the results of hard approaches with an objective social reality about the Agenda, we miss opportunities to change the way these interactions unfold, and, therefore, to achieve integrated and indivisible progress. These changes will be derived from the recognition that the worldviews of those currently in power and those currently vulnerable can be debated and perhaps changed-modifying each actor's appreciative system, and, thus, intervening in the workings of the system itself. We believe that at the most basic level, the world defined by the 2030 Agenda will be learned, not constructed, consistent with the learning paradigm promoted by Checkland as part of SSM.
Having argued for the use of soft systems thinking approaches to understanding SDG interactions, we next explore how prominent these are within the literature emerging on the subject. In the next section, we present an overview of the use of soft systems thinking methodologies vis à vis other more prominent approaches, based on Bennich et al.'s (2020) state-of-the-art review of SDG interactions methodologies.

Soft systems thinking approaches within state-of-the-art SDG interactions analysis
The review by Bennich et al. (2020) includes a breakdown of 70 different papers on SDG interactions. Two of the criteria they used to categorize papers seem particularly relevant to our experiment in Colombia: (i) the geographical scale of the analysis; and (ii) the data sources they employ. Of the 70 papers in the review, 28 studied potential SDG interactions at scales below the global, with just three of these 28 papers examining interactions in subnational contexts (Hutton et al., 2018;Liu, 2017;Pfaff et al., 2018). Two recent, additional papers have also analyzed SDG interactions at a subnational scale (Jiménez-Aceituno et al., 2020;Wang et al., 2020). Over 70% of the SDG interaction studies rely on scientific literature (including gray literature, i.e., policy reports and news articles) and/or official databases as their input, with published literature being the most common data source. Fewer papers used expert/stakeholder knowledge or direct observations in policy processes as the primary data source.
More common are papers that use descriptions of social and natural phenomena mapped to processes related to the SDGs. Some authors (e.g., Bowen et al., 2017;Stafford-Smith et al., 2017) cite the results of scientific publications to suggest national and global cobenefits and trade-offs among various topics addressed by the SDGs, without specifying which particular SDGs interact. Other authors are more explicit about the interactions they observe, using literature to postulate connections among the SDGs, and applying conceptual modeling techniques to show how the interactions at global and national scales may unfold (e.g., Alcamo, 2019;Costanza et al., 2016;Kanter et al., 2016;Kopainsky et al., 2018;Le Blanc, 2015;Lim et al., 2018). The scarcity of relevant published papers might explain the lack of analysis on subnational SDG interactions. In this regard, we identified only two subnational interaction studies that use literature as the main data source (Jiménez-Aceituno et al., 2020;Liu, 2017).
Other papers use quantitative methodologies, informed by publicly available databases of socioeconomic indicators compiled over time at global and national scales, to argue for more scalable alternatives (e.g., Ospina-Forero et al., 2020). These approaches calculate correlations and/or theories of causation to determine how progress toward a specific SDG potentially affects others. These represent hard systems thinking approaches. Some of these techniques include conventional statistical methods (Dörgo et al., 2018;Pradhan et al., 2017;Zhou & Moinuddin, 2017). Others employ system modeling methodologies, such as system dynamics (Kopainsky et al., 2018;Pedercini et al., 2018), agent-based models Guijun et al., 2017), integrated assessment models (Bijl et al., 2017;Hutton et al., 2018;Iyer et al., 2018;Moyer & Bohl, 2019), and econometric models (Campagnolo et al., 2018;Scherer et al., 2018). One of the most-cited SDG interactions papers is Pradhan et al. (2017), which uses the Spearman's rank correlation to find negative and positive interactions among indicators that monitor progress among the SDGs. Nonetheless, the paper uses data from the Inter-agency and Expert Group on SDG Indicators (IAEG-SDGs) (Inter-Agency & Expert Group on Sustainable Development Goal Indicators, 2016), which are assessed at the country level. Therefore, the calculated interactions are limited to global and country scales. Most papers in this category have the same limitation.
We have, however, identified two other approaches that can be categorized as hard systems thinking methods and that have been used in subnational studies (Hutton et al., 2018;Pfaff et al., 2018). These studies incorporate spatial analysis and socio-environmental modeling to infer interactions in localized, subnational regions. While these approaches do not use country-level development indicators, the methods employed require rigorous and high-definition spatial and environmental data, which might be scarce or unavailable-especially in developing countries (Scott & Rajabifard, 2017). This limitation entails restrictions on the number and type of SDG interactions that can be identified, which correspond to the nature and availability of the data used the methodologies. In this regard, none of these studies cover more than 10 SDGs, and the analysis remains at the SDG (rather than target) level.
In connection to this, a potential limitation of all of these approaches is that they only allow for the evaluation of SDG-to-SDG interactions. We identified only three papers that use exclusively official databases to calculate target-to-target interactions (Bali Swain & Ranganathan, 2021;Lusseau & Mancini, 2019;Scherer et al., 2018). Additionally, the review of Bennich et al. (2020) cites another study that accounts for interactions among targets using datasets, but it applies a multi-criteria analysis in combination with policy analysis and stakeholder consultation (Allen et al., 2019). The lack of target-to-target interaction studies that use official datasets may be explained by the fact that the databases used lack SDG-specific information; thus the authors typically assign proxies for the 2030 Agenda (e.g., Collste et al., 2017;Iyer et al., 2018;Obersteiner et al., 2016;Rosenthal et al., 2018). However, other studies employ the information available in the United Nations Global SDG Database, alone or in combination with other datasets (e.g., Dörgo et al., 2018;Ospina-Forero et al., 2020;Pradhan et al., 2017). Nonetheless, many of these SDG indicators have not been conceptualized, or they are not regularly produced by countries (UN, 2020). Thus, the number of targets than can be mapped are limited, and, therefore, the data are commonly aggregated in broader Goals. For example, a study by Ospina-Forero et al. (2020) uses a multi-techniques approach that combines statistical methods with physics-inspired methods to estimate networks of SDG interactions in four countries. The authors use the Global SDG Database, which they complement with two other datasets from the World Bank and the World Economic Forum; nonetheless, their research remains limited to finding interactions among Goals due to a lack of target-related indicators. This is an important limitation that policy makers must be aware of when using SDG-to-SDG studies to design policy priorities for the Agenda. Such studies obscure the socio-environmental processes that happen at the target level, where some targets can be more catalytic than others (e.g., Järnberg et al., 2021;Lusseau & Mancini, 2019;Weitz et al., 2018).
The lack of methodologies that can be used to understand and manage target-to-target interactions at the subnational scale has created a gap in the SDG interactions literature; most studies simply do not account for these types of interlinkages. In this regard, according to our revision, the only papers cited by Bennich et al. (2020) that could plausibly occupy this critical niche are based on "expert and stakeholder knowledge" approaches. Studies that rely on this type of input use methods that extract the subjective knowledge of relevant actors to characterize the systemic interactions of the SDGs. These represent the soft systems thinking approaches. Contrary to hard systems thinking approaches, these are not constrained by the existence of published knowledge or official databases-provided that there are relevant actors that are willing to partake in the study.
In this sense, the SDG Synergies approach (Weitz et al., 2018) deployed under this study is an example of a soft systems thinking methodology. The use of this methodology allows us to look at interlinkages at the national scale (the national government of Colombia) as well as the regional level (Department of Antioquia). Additionally, it is worth mentioning that, as Jiménez-Aceituno et al. (2020) noted, there are few studies comparing subnational interlinkages with national-scale interactions. Thus, to the best of our knowledge, our study is the first.
The proponents of hard systems thinking approaches raise concerns about the legitimacy of soft systems thinking approaches as applied to SDG interactions. For instance, Ospina-Forero et al. (2020) appeal to the use of already validated methods to compute SDG interactions and argue that none of the "first generation" SDG interaction methods (into which they group the SDG Synergies approach) "have passed any formal validation test." Here we would echo Checkland; the only validation pursued in human systems modeling emerges internally, through consensus among the actors in the system (Checkland, 1995). The SDGs were specifically designed to be "integrated and indivisible," and to "leave no one behind." Thus, we prefer to avoid methods that can only be "validated" within existing systems of power, authority, and bureaucracy, and those that have a limited scope, stemming from a view that relies solely on SDG-to-SDG interactions at the national scale. Furthermore, we are convinced that efforts to implement Agenda 2030 in local contexts can have national and/or global impacts, generating cross-scale interactions (see Hoff, 2018;Liu, 2017). Indeed, the reverse can also be true; national and global efforts can affect the local context too. Only by exploring these cross-scale interactions can we study and design bottom-up actions to enhance the global achievement of the Agenda. At least for now, soft systems thinking approaches are the only way to seize this opportunity.

Methodology
The SDG Synergies approach is central to our exploration of potential differences in SDG interactions at national and subnational scales. Thus, we first present the theoretical basis of the approach, and we then describe the workshops organized to facilitate its application.

The SDG synergies approach
The SDG Synergies approach (Weitz et al., 2018) is a cross-impact methodology tailored explicitly to characterize interactions among the SDGs and their targets, and to then model the network-wide implications of these characterizations. The methodology uses expertand stakeholder-based knowledge as the input, and then integrates network analysis to account for the systemic properties of the SDGs-such as synergies and trade-offs. The results can be used as a basis for policy prioritization and cooperation among sectors in charge of the implementation of specific SDGs (Nilsson & Weitz, 2019;Weitz et al., 2018).
The approach draws from previous work on the conceptualization of SDG interactions (Nilsson et al., 2016) that proposed capturing the value of interlinkages through a sevenpoint scale: "indivisible" (+ 3), "reinforcing" (+ 2), "enabling" (+ 1) scores to, characterize synergies; "constraining" (−1), "counteracting" (−2), and "cancelling" (−3) to characterize trade-offs; and (0) to score "consistent" values in the case of situations in which no interactions occur. In the approach, this typology is used to answer the question, "If progress is made on target x, how does this influence progress on target y?". The resulting scores are then introduced in a cross-impact matrix-with the influencing targets in the row elements, and the column elements indicating the influenced targets.
The net influence of each target is determined by the sum of its interactions using the seven-point typology. The effect that one target has on every other is called the weighted out-degree, or out-degree. The degree through which one target is influenced by the rest of the Agenda is its weighted in-degree, or in-degree. A high out-degree value means that a target can make the achievement of other SDGs easier; a negative or low out-degree number indicates that the target hinders the achievement of others. A high weighted in-degree means that succeeding in the whole Agenda influences positively that target; conversely, a negative or low value for an in-degree indicates that progress in the rest of the SDGs could make progress in that target difficult.
The filled matrix is then interpreted as a weighted directed network, where each SDG target is a node, and the interlinkages between them are edges. Using network analysis allows the calculation of the second-order weighted out-degree (henceforth referred to as second-order degree), which estimates the systemic impact of one target beyond its closest neighbors.
Finally, the method also permits the detection of groups of highly connected targets through a clusterization process. In this regard, identifying clusters can guide cooperation between sectors that positively influence each other, build partnerships for governance, and set the stage for negotiations between sectors with potentially negative interactions. For this calculation we used the Gephi software and its embedded clusterization algorithm for both exercises (see Blondel et al., 2008).

SDG targets selection for the studies
Within the framework of the project, towards coherent implementation of the environmental dimension of the SDGs, the Stockholm Environment Institute (SEI), and the UN Environment Programme (UNEP) conducted two studies in Colombia: a national analysis, and a regional study in the Department of Antioquia. The rationale behind both projects was not only to assess SDG interactions but to directly play a role in the policy processes behind SDG implementation, creating spaces of discussion for stakeholders at both levels of government. At the national scale, we conducted a workshop oriented toward supporting Colombia's National Commission on SDGs regarding inter-institutional coordination efforts for the implementation of the Agenda. At the departmental level, we conducted a study that sought to inform the new Development Plan for Antioquia.
It has been stressed that SDG interactions are context specific. In this regard, there needs to be a contextualization phase for the SDG Synergies approach in which relevant targets are selected and mapped to their corresponding national and regional policies. Regarding target selection, the approach could potentially be used to assess interactions among all the 169 SDG targets. However, this would be time and resource intensive. Therefore, a target selection is necessary to make the method feasible. In our case studies, selection was based on three specific criteria: (1) alignment with relevant policies and plans; (2) respect for the integrated character of Agenda 2030 (addressed by including environmental, social, and economic targets, with a special focus on targets related to natural resources and their use); and the feasibility of the analysis for the time available in 2-day workshops. The target selection was made in collaboration with relevant policy makers and stakeholders behind the implementation of the Agenda at both scales. These participants also engaged in the scoring of the matrices. This means that the selected SDGs already express the motivations and priorities of decision-makers in charge of the Agenda. This is an important aspect in the contextualization phase of the methodology, which helps to focus the analysis on the SDGs that are perceived as most impactful, negatively or positively. Twenty targets were prioritized for the national study with the input of the National Planning Department and the Ministry of Environment and Sustainable Development. For the Antioquia exercise, 15 targets were chosen together with the national and regional partners (the full list of targets for each workshop can be reviewed on Appendix 2). From this selection, 13 SDGs appear in both studies.
The selected targets were then mapped to the relevant national and regional policies. This crucial step helps to characterize the policy processes behind the SDGs in their particular environmental, political, and economic settings. In this regard, during the workshops, the participants were provided with leaflets with the texts of the selected targets and their alignment with commitments in the National Development Plan (for the national study) or the Antioquia Departmental Development Strategy (for the subnational analysis).

The national and regional workshops
Two 2-day workshops were held-on November 29-30, 2018, in Medellin, for the Antioquia study; and on March 7-8, 2019, in Bogota for the national study. There were 100 participants in the national workshop, and 60 in the regional one. Some participants were selected from governmental, civil, and private institutions involved in the implementation of the Agenda at the regional and national levels; other respondents were selected based on their expertise in the topics covered. The selection process was undertaken with the national and regional partners, who considered relevant actors and potential participants to select them according to these criteria (see Appendix 1 for details about the participating institutions in the studies). For both workshops, the analysis was complemented with the web-based SDG Synergies tool (SEI, 2020), which was developed by SEI to support the application of the methodology, and to allow for quick scoring and visualizations of the results.
In the spirit of soft systems thinking, discussion groups of five or six participants were created. Organizers encouraged participants to debate the subjects up for discussion before answering questions. At the same time, each participant had personal access to the tool, meaning that he or she could score each interaction individually. Upon clicking an interaction on the matrix, a window appeared with the question "If progress is made on target x, how does this influence progress on target y?" (see Fig. 1), where the participants could choose a score from the seven-point typology. The respondents could indicate whether they were uncertain about their score, and they could provide an explanation for the interactions.
The tool automatically calculated all the scores, displaying the results in real time as the participants filled in the matrix. Then, the findings were displayed for debate in plenary: a session held to offer a closer look at interlinkages. These sessions revealed significant variation in participants' scoring. The facilitators of the plenary encouraged debate about the processes behind these interactions, and discussion about how to manage them better. Scores could be adjusted based on the discussion, suggesting a fluidity of interpretation distinct from one that relies on rigidly applying (presumably) relevant indicators. Thus, the approach gathered stakeholders and decision-makers from different sectors to analyze and discuss interactions as part of a learning paradigm.
In the next section, we compare the results from both exercises. To highlight the differences in the data, we created two matrices containing the 13 specific targets that appeared in both studies. These calculations are based on the participant scores minus the values of the non-repeated targets (the complete results of the case studies can be reviewed in Appendix 3). All the graphic artwork in the next section was created using the SDG Synergies tool (SEI, 2020).

First-order interaction values
One can observe which SDGs positively or negatively affect the rest of the Agenda by examining the first-order interaction values. Neither matrix had SDGs with negative outdegree or in-degree values, suggesting that the targets are not logically inconsistent in either direction. In the national matrix (Fig. 2), the most synergistic target is target 11.6 (Environmental impact of cities), with an out-degree of 29; targets 9.5 (Science and technology) and 12.5 (Waste reduction) share second place with a score of 2.5. By contrast, in the Antioquia matrix (Fig. 3), the highest-ranking target is target 12.5 (Environmental Fig. 1 The SDG Synergies tool. The platform is tailored specifically for the SDGs. The tool allows for the scoring of cross-impact matrices impact of cities), with an out-degree of 24; in the second place, target 2.4 (Sustainable agriculture) has a score of 23. Moreover, none of these targets produce trade-offs in their respective matrices, which suggests that they do not cause limiting effects for other targets. High-ranking synergistic targets such as these should be granted priority in the execution of the SDGs because they have the most potential to contribute to the Agenda's achievement (Weitz et al., 2018).
On the other hand, the most influenced targets in the national matrix, ranked by their in-degree, are targets 1.5 (Resilience, scored 25) and 6.3 (Water quality, scored 24). In the Antioquia analysis, the most influenced targets are targets 1.5 (Resilience, scored 26) and 2.4 (Sustainable agriculture, scored 25). In this sense, targets with a high in-degree can make the most advantage of progress on the Agenda as a whole. (Weitz et al., 2018).
Regarding the SDGs displaying trade-offs, in the national matrix, the target 5.a (Women economic empowerment) is the only one showing a negative link -with target 12.5 (Waste reduction). By contrast, in the Antioquia matrix targets 7.2 (Renewable energy), 8.3 (Decent job creation and growth of small-sized enterprises), and 15.1 (Terrestrial and freshwater ecosystems) have negative links. Target 8.3 has the most trade-offs (four). It is crucial to implement these SDGs with caution, and to consider and devise mitigation . Blue circles depict synergies, and red circles depict trade-offs. Yellow dots represent no interaction between the targets. The out-degree and in-degree of each target are placed on the row sum and column sum, respectively measures to address their trade-offs. Otherwise, other wider SDG efforts could be compromised (Weitz et al., 2018).
A comparison of both matrices reveals how one specific SDG target can behave differently depending on the exercise and context. For example, in the national analysis, target 8.3 (Decent job creation and growth of small-sized enterprises) has synergies (+ 1) with targets 11.6 (Environmental impact of cities), 12.4 (Chemical product management), and 12.5 (Waste reduction) (see Fig. 4). By contrast in the Antioquia study, target 8.3 produces trade-offs (−1) with those same three SDGs. These results illustrate that SDG interactions can show stark differences at different scales in the same country.

Network analysis: second-order degrees
There are minor variations in the rankings when comparing first-order out-degrees with the second-order scores (see Table 1). In the national study, targets have very similar rankings in both tables. However, in the first-order ranking, some targets share the same position on the list. For instance, targets 12.5 (Waste reduction) and 9.5 (Science and technology) are both located in the second spot with an out-degree of 25. By contrast, the second-order  ranking shows more differences between the two scores. It can thus be used as a tiebreaker when prioritizing policy actions. In the Antioquia study, the three most influential SDGs remain unchanged in both rankings (targets 12.5, Waste reduction; 2.4, Sustainable agriculture; and 12.4, Chemical product management). However, the Antioquia calculations show more variance in the rankings than the national counterpart calculations. In sum, evident differences emerge in the results of the two exercises. For instance, the most obvious differences can be seen in the results concerning target 8.3 (Decent job creation and growth of small-sized enterprises), which generates synergies with targets 11.6 (Environmental impact of cities), 12.4 (Chemical product management), and 12.5 (Waste reduction) in the national analysis, while producing trade-offs in Antioquia with those same targets. As this example shows, one specific SDG target can have contrasting interlinkages with the same pairs of targets when analyzed at different scales. This finding implies that contextual and scale-related differences can define the occurrence of synergies or trade-offs. This suggests that characterizations at the local scale can produce a more complex network, with discussion among stakeholders revealing synergies and trade-offs between specific interventions in that territory, in contrast to more abstract discussion that may emerge at a national scale. As one of the first comparisons between national and subnational SDG interactions, our study confirms assertions by prior researchers (Jiménez-Aceituno et al., 2020;Reed et al., 2015;Stephens et al., 2018) that the nature SDG interactions can vary significantly based on local contexts and realities.

Discussion
To date, most attention has been on the national scale for SDG interaction analyses, creating a dearth of studies measuring interactions at subnational levels. In this paper we argue that there is a need to deploy methods that are not limited by the comparative lack of data availability in subnational settings-particularly in light of the premise that the nature of interactions is context dependent, the findings that have surfaced in our case study, and the absence of credible subnational-level data. We address this issue by using the SDG Synergies approach to account for interlinkages at two scales of analysis in Colombia, the national and the regional. The application of the method brought together a wide range of key stakeholders behind the implementation of the SDGs at both levels of governance. From a soft systems thinking perspective, the observed interactions are based on information that these actors will use to decide when executing the SDGs, thus driving the implementation of the Agenda. In this sense, according to Weitz et al. (2018) and Nilsson and Weitz (2019), the results from the approach can be used as a basis for policy coherence efforts to enhance the implementation of the SDGs.
In this regard, the use of soft systems thinking facilitated dialogue among various actors involved in the implementation of the Agenda. As Nilsson and Weitz (2019) point out, it is essential to use methods in which SDG interactions are calculated in ways that account for "the diverse values, world views, and legitimate interests of different stakeholders. These will influence how issues and knowledge are interpreted and used in political processes," These authors argue that an SDGs interactions-assessment framework is most useful to governments if the process takes place within the policy-making processes because the different institutions or government departments that partake in it will "…come together and jointly identify how they relate to each other in terms of their respective priorities, and on what topics negotiations are required to manage trade-offs," The implication is that through the discussion process of soft systems thinking methodologies, the different subjective understandings of how the SDGs interact will be shared among the participants, influencing the stakeholders' worldviews, and fostering cooperation among them.
Our findings also show that SDG interactions can take very different forms when observed at different scales. The interlinkages for both case studies were assessed in Colombia, in a shared territory and policy-making space. The contrasting results of the studies at national and department levels begs the question: What are the implications for policy coherence between national-and Antioquia-level policies? For instance, in terms of policy prioritization, the most influential target in the national matrix is 11.6 (Environmental impact of cities); in Antioquia, it is 12.5 (Waste reduction). The question then follows as to whether a country-level policy concerning target 11.6 would have the same catalytic effect in the department of Antioquia as in Colombia as a country. Similarly, we can ask if national policies can produce unequal development in subnational territories, affecting some regions positively and others negatively-creating trade-offs. This possibility is illustrated by target 8.3 (Decent job creation and growth of small-sized enterprises), which has a positive effect with the rest of the Agenda at the national scale, while generating trade-offs in Antioquia when interacting with four targets: 6.3 (Water quality), 11.6 (Environmental impact of cities), 12.4 (Chemical product management), and 12.5 (Waste reduction). A closer examination of the policy actions behind these trade-offs would be needed to establish safeguards to mitigate these negative effects, and to make sure that the Colombian national SDG strategy and Antioquia-level policies align. On the other hand, Liu (2017) has suggested that local SDG efforts have the potential to generate interactions at scales larger than the territories in which they are implemented. Thus, these same questions emerge in an opposite direction. One must ask whether Antioquia-level SDG actions can have an influence outside that department's boundaries.
These are important concerns that create a higher level of complexity in enhancing policy coherence for SDG implementation in Colombia. Although the results are specific to Colombia, other scale-related differences are likely to manifest themselves elsewhere. It is thus paramount for other SDG researchers and practitioners to use strategies that enhance policy coherence across scales.
In this regard, the literature has already pointed out the need to apply multilevel governance strategies to align SDG efforts (see Fenton & Gustafsson, 2017;Meuleman & Niestroy, 2015;Sospedra & Martin, 2005). However, nothing has been said about how to effectively address differences in SDG interactions across-scale once such differences have been revealed and acknowledged. Along these lines, from a soft systems thinking perspective, SDG interactions can be managed most effectively not by technical solutions in isolation, but through the participation, discussion, and consensus of involved stakeholders.
Therefore, there needs to be a participatory evaluation between stakeholders at different levels of governance about how the decisions at one scale of implementation can affect another. We believe that there is substantial potential in soft systems thinking methodologies for creating such spaces for discussion, where various stakeholders of different scales of government share, debate, and, one hopes, reach agreement on their mutual interests and various worldviews-influencing the workings of the governance systems that determine progress on the SDGs. Furthermore, the continued use of these methodologies in policy making for the SDGs would allow for adaptative management of policies as decisions adjust in the process of assessing unexpected effects and emerging issues.
However, the methodology in its current state does not consider how interactions in different places, regions, and scales affect each other. This process would entail gathering actors from various contexts and geographies to create a multi-regional matrix that accounts for the effects of SDG implementation across territories. In this regard, the development and application of a soft methodology that specifically tackles cross-scale SDG interactions is a topic for further research. In fact, this cross-scale harmonization effort may provide an opportunity to coordinate soft systems thinking with other emerging SDGinteraction approaches, including hard systems thinking methods. Hard systems thinking approaches claim some predictive capacity as to how SDGs will interact at the national scale, based on a paradigm that relies on existing structures of power and authority. Soft systems thinking approaches could use this as a jumping-off point. Rather than starting the matrix construction process from a blank slate, participants could discuss how to adjust scores derived from these predictions in the context of specific SDG targets, specific scales, and specific opportunities to adjust existing structure toward the overall SSM objective of "change to bring about improvement" in the context of the Agenda 2030. Such integration could offer insights into specific policy reforms, in addition to aiding prioritization, collaboration, and negotiation.
Finally, the SDG Synergies approach can be improved by integrating the participativeiterative methodologies of OR and other soft systems thinking, such as Checkland's SSM. Incorporating such methodologies would entail exploring how cross-impact analysis captures and modifies respondents' "appreciative systems," and proposing new procedures based on this theoretical grounding.

Conclusions
Understanding the synergies and trade-offs of the interactions among the Sustainable Development Goals requires thinking about the ramifications at the specific scales where implementation occurs to achieve the aims of individual targets, SDGs, and the full menu of elements of the 2030 Agenda. Nevertheless, our literature review shows that most studies use approaches that rely on data that provide information from the country level only. Methodologies that rely almost exclusively on information from national scales assume that aggregate patterns of progress at the national level hold true for subnational scales, too-an assumption that is undercut by our findings.
To the best of our knowledge, our study is one of the first of its kind to examine the interactions of selected SDGs and targets at the national and subnational scales. Our study looked at the synergies and trade-offs for both Colombia, at the national scale, and for one of its departments, Antioquia, at the regional scale. Our findings show profound differences in the synergies and trade-offs at these two different scales. For example, target 8.3 (Decent job creation and growth of small-sized enterprises) generates synergies with targets 11.6 (Environmental impact of cities), 12.4 (Chemical product management), and 12.5 (Waste reduction) at the national level but trade-offs at the department level with the same targets. These findings show that closer examination of the policy actions behind these differences is needed to mitigate the negative trade-offs from policy measures, and to make sure national and regional level strategies are aligned.
More broadly, we argue that subnational assessments of SDG interactions are vital for the effective implementation of the Agenda. Methods and tools that can analyze SDGs and target interactions at the subnational scale must be developed-and soon, if the 2030 Agenda target date is to be met.
To tackle this gap, we propose the use of soft systems thinking methodologies as a way forward. Such methodologies are not limited by the availability of official data at any scale. Our own study used the SDG Synergies approach, a soft systems thinking method, to account for SDG interactions at the national and subnational scales, and, as such, it demonstrates the viability of the use of such a system in the absence of available data.
Moreover, our wider examination of soft systems thinking methodologies vis à vis other approaches leads us to conclude that such systems are a preferable means for characterizing SDG interactions, regardless of the scale of analysis. This is because soft systems thinking can create spaces for discussion and agreement among stakeholders; this is crucial for confronting the structures of power and bureaucracy behind the implementation of the SDGs. Our research shows that such power structures can underlie the patterns and mechanisms identified through hard systems thinking methodologies, which are then characterized as SDG interactions. In this context, the different understanding of social reality that emerges from a hard or soft systems approaches is important. If we confuse the results of hard approaches with an objective social reality about the Agenda, we may miss opportunities to transform how these interactions behave through soft systems thinking. Moreover, the potential for cross-scale interactions raises important questions for policy coherence when implementing the SDGs at different governance levels, even within the same country. We propose further developing and using soft systems thinking methodologies to manage political conflict and cooperation in SDG implementation.

3
Entities and organizations that participated in the national study By 2030, ensure sustainable food production systems and implement resilient agricultural practices that increase productivity and production, that help maintain ecosystems, that strengthen capacity for adaptation to climate change, extreme weather, drought, flooding and other disasters and that progressively improve land and soil quality 3.9 By 2030, substantially reduce the number of deaths and illnesses from hazardous chemicals and air, water and soil pollution and contamination 5.a Undertake reforms to give women equal rights to economic resources, as well as access to ownership and control over land and other forms of property, financial services, inheritance and natural resources, in accordance with national laws 6.1 By 2030, achieve universal and equitable access to safe and affordable drinking water for all 6.3 By 2030, improve water quality by reducing pollution, eliminating dumping and minimizing release of hazardous chemicals and materials, halving the proportion of untreated wastewater and substantially increasing recycling and safe reuse globally 6.4 By 2030, substantially increase water-use efficiency across all sectors and ensure sustainable withdrawals and supply of freshwater to address water scarcity and substantially reduce the number of people suffering from water scarcity 7.2 By 2030, increase substantially the share of renewable energy in the global energy mix SDG Description 8.3 Promote development-oriented policies that support productive activities, decent job creation, entrepreneurship, creativity and innovation, and encourage the formalization and growth of micro-, small-and medium-sized enterprises, including through access to financial services 8.4 Improve progressively, through 2030, global resource efficiency in consumption and production and endeavour to decouple economic growth from environmental degradation, in accordance with the 10 Year Framework of Programmes on Sustainable Consumption and Production, with developed countries taking the lead 9.5 Improve progressively, through 2030, global resource efficiency in consumption and production and endeavour to decouple economic growth from environmental degradation, in accordance with the 10 Year Framework of Programmes on Sustainable Consumption and Production, with developed countries taking the lead 11.6 By 2030, reduce the adverse per capita environmental impact of cities, including by paying special attention to air quality and municipal and other waste management 12.4 By 2020, achieve the environmentally sound management of chemicals and all wastes throughout their life cycle, in accordance with agreed international frameworks, and significantly reduce their release to air, water and soil in order to minimize their adverse impacts on human health and the environment 12.5 By 2030, substantially reduce waste generation through prevention, reduction, recycling and reuse 13. By 2030, ensure sustainable food production systems and implement resilient agricultural practices that increase productivity and production, that help maintain ecosystems, that strengthen capacity for adaptation to climate change, extreme weather, drought, flooding and other disasters and that progressively improve land and soil quality 5.a Undertake reforms to give women equal rights to economic resources, as well as access to ownership and control over land and other forms of property, financial services, inheritance and natural resources, in accordance with national laws 6.1 By 2030, achieve universal and equitable access to safe and affordable drinking water for all 6.3 By 2030, improve water quality by reducing pollution, eliminating dumping and minimizing release of hazardous chemicals and materials, halving the proportion of untreated wastewater and substantially increasing recycling and safe reuse globally 6.6 By 2020, protect and restore water-related ecosystems, including mountains, forests, wetlands, rivers, aquifers and lakes 7.2 By 2030, increase substantially the share of renewable energy in the global energy mix 8.3 Promotedevelopment-oriented policies that support productive activities, decent job creation, entrepreneurship, creativity and innovation, and encourage the formalization and growth of micro-, small-and medium-sized enterprises, including through access to financial services 9.5 Improve progressively, through 2030, global resource efficiency in consumption and production and endeavour to decouple economic growth from environmental degradation, in accordance with the 10 Year Framework of Programmes on Sustainable Consumption and Production, with developed countries taking the lead 11.6 By 2030, reduce the adverse per capita environmental impact of cities, including by paying special attention to air quality and municipal and other waste management 12.4 By 2020, achieve the environmentally sound management of chemicals and all wastes throughout their life cycle, in accordance with agreed international frameworks, and significantly reduce their release to air, water and soil in order to minimize their adverse impacts on human health and the environment 12.5 By 2030, substantially reduce waste generation through prevention, reduction, recycling and reuse 13.3 Improve education, awareness-raising and human and institutional capacity on climate change mitigation, adaptation, impact reduction and early warning