Scenario analysis enhance reflexivity, deconstructs cognitive biases and flawed assumptions, and enables the imagination and creation of alternative futures.

Over the past decade, the “cult of irrelevance” in political science scholarship has been lamented by a growing chorus (Putnam 2003; Nye 2009; Walt 2009). Prominent scholars of international affairs have diagnosed the roots of the gap between academia and policymaking, made the case for why political science research is valuable for policymaking, and offered a number of ideas for enhancing the policy relevance of scholarship in international relations and comparative politics (Walt 2005,2011; Mead 2010; Van Evera 2010; Jentleson and Ratner 2011; Gallucci 2012; Avey and Desch 2014). Building on these insights, several initiatives have been formed in the attempt to “bridge the gap.”2 Many of the specific efforts put in place by these projects focus on providing scholars with the skills, platforms, and networks to better communicate the findings and implications of their research to the policymaking community, a necessary and worthwhile objective for a field in which theoretical debates, methodological training, and publishing norms tend more and more toward the abstract and esoteric. Yet enhancing communication between scholars and policymakers is only one component of bridging the gap between international affairs theory and practice. Another crucial component of this bridge is the generation of substantive research programs that are actually policy relevant—a challenge to which less concerted attention has been paid. The dual challenges of bridging the gap are especially acute for graduate students, a particular irony since many enter the discipline with the explicit hope of informing policy. In a field that has an admirable devotion to pedagogical self-reflection, strikingly little attention is paid to techniques for generating policy-relevant ideas for dissertation and other research topics. Although numerous articles and conference workshops are devoted to the importance of experiential and problem-based learning, especially through techniques of simulation that emulate policymaking processes (Loggins 2009; Butcher 2012; Glasgow 2012; Rothman 2012; DiCicco 2014), little has been written about the use of such techniques for generating and developing innovative research ideas. This article outlines an experiential and problem-based approach to developing a political science research program using scenario analysis. It focuses especially on illuminating the research generation and pedagogical benefits of this technique by describing the use of scenarios in the annual New Era Foreign Policy Conference (NEFPC), which brings together doctoral students of international and comparative affairs who share a demonstrated interest in policy-relevant scholarship.3 In the introductory section, the article outlines the practice of scenario analysis and considers the utility of the technique in political science. We argue that scenario analysis should be viewed as a tool to stimulate problem-based learning for doctoral students and discuss the broader scholarly benefits of using scenarios to help generate research ideas. The second section details the manner in which NEFPC deploys scenario analysis. The third section reflects upon some of the concrete scholarly benefits that have been realized from the scenario format. The fourth section offers insights on the pedagogical potential associated with using scenarios in the classroom across levels of study. A brief conclusion reflects on the importance of developing specific techniques to aid those who wish to generate political science scholarship of relevance to the policy world. What Are Scenarios and Why Use Them in Political Science? Scenario analysis is perceived most commonly as a technique for examining the robustness of strategy. It can immerse decision makers in future states that go beyond conventional extrapolations of current trends, preparing them to take advantage of unexpected opportunities and to protect themselves from adverse exogenous shocks. The global petroleum company Shell, a pioneer of the technique, characterizes scenario analysis as the art of considering “what if” questions about possible future worlds. Scenario analysis is thus typically seen as serving the purposes of corporate planning or as a policy tool to be used in combination with simulations of decision making. Yet scenario analysis is not inherently limited to these uses. This section provides a brief overview of the practice of scenario analysis and the motivations underpinning its uses. It then makes a case for the utility of the technique for political science scholarship and describes how the scenarios deployed at NEFPC were created. The Art of Scenario Analysis We characterize scenario analysis as the art of juxtaposing current trends in unexpected combinations in order to articulate surprising and yet plausible futures, often referred to as “alternative worlds.” Scenarios are thus explicitly not forecasts or projections based on linear extrapolations of contemporary patterns, and they are not hypothesis-based expert predictions. Nor should they be equated with simulations, which are best characterized as functional representations of real institutions or decision-making processes (Asal 2005). Instead, they are depictions of possible future states of the world, offered together with a narrative of the driving causal forces and potential exogenous shocks that could lead to those futures. Good scenarios thus rely on explicit causal propositions that, independent of one another, are plausible—yet, when combined, suggest surprising and sometimes controversial future worlds. For example, few predicted the dramatic fall in oil prices toward the end of 2014. Yet independent driving forces, such as the shale gas revolution in the United States, China’s slowing economic growth, and declining conflict in major Middle Eastern oil producers such as Libya, were all recognized secular trends that—combined with OPEC’s decision not to take concerted action as prices began to decline—came together in an unexpected way. While scenario analysis played a role in war gaming and strategic planning during the Cold War, the real antecedents of the contemporary practice are found in corporate futures studies of the late 1960s and early 1970s (Raskin et al. 2005). Scenario analysis was essentially initiated at Royal Dutch Shell in 1965, with the realization that the usual forecasting techniques and models were not capturing the rapidly changing environment in which the company operated (Wack 1985; Schwartz 1991). In particular, it had become evident that straight-line extrapolations of past global trends were inadequate for anticipating the evolving business environment. Shell-style scenario planning “helped break the habit, ingrained in most corporate planning, of assuming that the future will look much like the present” (Wilkinson and Kupers 2013, 4). Using scenario thinking, Shell anticipated the possibility of two Arab-induced oil shocks in the 1970s and hence was able to position itself for major disruptions in the global petroleum sector. Building on its corporate roots, scenario analysis has become a standard policymaking tool. For example, the Project on Forward Engagement advocates linking systematic foresight, which it defines as the disciplined analysis of alternative futures, to planning and feedback loops to better equip the United States to meet contemporary governance challenges (Fuerth 2011). Another prominent application of scenario thinking is found in the National Intelligence Council’s series of Global Trends reports, issued every four years to aid policymakers in anticipating and planning for future challenges. These reports present a handful of “alternative worlds” approximately twenty years into the future, carefully constructed on the basis of emerging global trends, risks, and opportunities, and intended to stimulate thinking about geopolitical change and its effects.4 As with corporate scenario analysis, the technique can be used in foreign policymaking for long-range general planning purposes as well as for anticipating and coping with more narrow and immediate challenges. An example of the latter is the German Marshall Fund’s EuroFutures project, which uses four scenarios to map the potential consequences of the Euro-area financial crisis (German Marshall Fund 2013). Several features make scenario analysis particularly useful for policymaking.5 Long-term global trends across a number of different realms—social, technological, environmental, economic, and political—combine in often-unexpected ways to produce unforeseen challenges. Yet the ability of decision makers to imagine, let alone prepare for, discontinuities in the policy realm is constrained by their existing mental models and maps. This limitation is exacerbated by well-known cognitive bias tendencies such as groupthink and confirmation bias (Jervis 1976; Janis 1982; Tetlock 2005). The power of scenarios lies in their ability to help individuals break out of conventional modes of thinking and analysis by introducing unusual combinations of trends and deliberate discontinuities in narratives about the future. Imagining alternative future worlds through a structured analytical process enables policymakers to envision and thereby adapt to something altogether different from the known present. Designing Scenarios for Political Science Inquiry The characteristics of scenario analysis that commend its use to policymakers also make it well suited to helping political scientists generate and develop policy-relevant research programs. Scenarios are essentially textured, plausible, and relevant stories that help us imagine how the future political-economic world could be different from the past in a manner that highlights policy challenges and opportunities. For example, terrorist organizations are a known threat that have captured the attention of the policy community, yet our responses to them tend to be linear and reactive. Scenarios that explore how seemingly unrelated vectors of change—the rise of a new peer competitor in the East that diverts strategic attention, volatile commodity prices that empower and disempower various state and nonstate actors in surprising ways, and the destabilizing effects of climate change or infectious disease pandemics—can be useful for illuminating the nature and limits of the terrorist threat in ways that may be missed by a narrower focus on recognized states and groups. By illuminating the potential strategic significance of specific and yet poorly understood opportunities and threats, scenario analysis helps to identify crucial gaps in our collective understanding of global politicaleconomic trends and dynamics. The notion of “exogeneity”—so prevalent in social science scholarship—applies to models of reality, not to reality itself. Very simply, scenario analysis can throw into sharp relief often-overlooked yet pressing questions in international affairs that demand focused investigation. Scenarios thus offer, in principle, an innovative tool for developing a political science research agenda. In practice, achieving this objective requires careful tailoring of the approach. The specific scenario analysis technique we outline below was designed and refined to provide a structured experiential process for generating problem-based research questions with contemporary international policy relevance.6 The first step in the process of creating the scenario set described here was to identify important causal forces in contemporary global affairs. Consensus was not the goal; on the contrary, some of these causal statements represented competing theories about global change (e.g., a resurgence of the nation-state vs. border-evading globalizing forces). A major principle underpinning the transformation of these causal drivers into possible future worlds was to “simplify, then exaggerate” them, before fleshing out the emerging story with more details.7 Thus, the contours of the future world were drawn first in the scenario, with details about the possible pathways to that point filled in second. It is entirely possible, indeed probable, that some of the causal claims that turned into parts of scenarios were exaggerated so much as to be implausible, and that an unavoidable degree of bias or our own form of groupthink went into construction of the scenarios. One of the great strengths of scenario analysis, however, is that the scenario discussions themselves, as described below, lay bare these especially implausible claims and systematic biases.8 An explicit methodological approach underlies the written scenarios themselves as well as the analytical process around them—that of case-centered, structured, focused comparison, intended especially to shed light on new causal mechanisms (George and Bennett 2005). The use of scenarios is similar to counterfactual analysis in that it modifies certain variables in a given situation in order to analyze the resulting effects (Fearon 1991). Whereas counterfactuals are traditionally retrospective in nature and explore events that did not actually occur in the context of known history, our scenarios are deliberately forward-looking and are designed to explore potential futures that could unfold. As such, counterfactual analysis is especially well suited to identifying how individual events might expand or shift the “funnel of choices” available to political actors and thus lead to different historical outcomes (Nye 2005, 68–69), while forward-looking scenario analysis can better illuminate surprising intersections and sociopolitical dynamics without the perceptual constraints imposed by fine-grained historical knowledge. We see scenarios as a complementary resource for exploring these dynamics in international affairs, rather than as a replacement for counterfactual analysis, historical case studies, or other methodological tools. In the scenario process developed for NEFPC, three distinct scenarios are employed, acting as cases for analytical comparison. Each scenario, as detailed below, includes a set of explicit “driving forces” which represent hypotheses about causal mechanisms worth investigating in evolving international affairs. The scenario analysis process itself employs templates (discussed further below) to serve as a graphical representation of a structured, focused investigation and thereby as the research tool for conducting case-centered comparative analysis (George and Bennett 2005). In essence, these templates articulate key observable implications within the alternative worlds of the scenarios and serve as a framework for capturing the data that emerge (King, Keohane, and Verba 1994). Finally, this structured, focused comparison serves as the basis for the cross-case session emerging from the scenario analysis that leads directly to the articulation of new research agendas. The scenario process described here has thus been carefully designed to offer some guidance to policy-oriented graduate students who are otherwise left to the relatively unstructured norms by which political science dissertation ideas are typically developed. The initial articulation of a dissertation project is generally an idiosyncratic and personal undertaking (Useem 1997; Rothman 2008), whereby students might choose topics based on their coursework, their own previous policy exposure, or the topics studied by their advisors. Research agendas are thus typically developed by looking for “puzzles” in existing research programs (Kuhn 1996). Doctoral students also, understandably, often choose topics that are particularly amenable to garnering research funding. Conventional grant programs typically base their funding priorities on extrapolations from what has been important in the recent past—leading to, for example, the prevalence of Japan and Soviet studies in the mid-1980s or terrorism studies in the 2000s—in the absence of any alternative method for identifying questions of likely future significance. The scenario approach to generating research ideas is grounded in the belief that these traditional approaches can be complemented by identifying questions likely to be of great empirical importance in the real world, even if these do not appear as puzzles in existing research programs or as clear extrapolations from past events. The scenarios analyzed at NEFPC envision alternative worlds that could develop in the medium (five to seven year) term and are designed to tease out issues scholars and policymakers may encounter in the relatively near future so that they can begin thinking critically about them now. This timeframe offers a period distant enough from the present as to avoid falling into current events analysis, but not so far into the future as to seem like science fiction. In imagining the worlds in which these scenarios might come to pass, participants learn strategies for avoiding failures of creativity and for overturning the assumptions that prevent scholars and analysts from anticipating and understanding the pivotal junctures that arise in international affairs.