Data supporting DPT is stronger than smoking causes lung cancer---they use regression analysis, we use nonparametric sensitivity analysis, we are not the same
Kosuke Imai and James Lo 21, Professor of Government and Statistics, Harvard. "Robustness of Empirical Evidence for the Democratic Peace: A Nonparametric Sensitivity Analysis" International Organization, Volume 75, Issue 3. April 5.. https://www.cambridge.org/core/journals/international-organization/article/abs/robustness-of-empirical-evidence-for-the-democratic-peace-a-nonparametric-sensitivity-analysis/66A4FFF9F79348AB926284EC32EC11AB //pipk
The democratic peace—the idea that democracies rarely fight one another—has been called “the closest thing we have to an empirical law in the study of international relations.” Yet, some contend that this relationship is spurious and suggest alternative explanations. Unfortunately, in the absence of randomized experiments, we can never rule out the possible existence of such confounding biases. Rather than commonly used regression-based approaches, we apply a nonparametric sensitivity analysis. We show that overturning the negative association between democracy and conflict would require a confounder that is forty-seven times more prevalent in democratic dyads than in other dyads. To put this number in context, the relationship between democracy and peace is at least five times as robust as that between smoking and lung cancer. To explain away the democratic peace, therefore, scholars would have to find far more powerful confounders than those already identified in the literature.
The proposition that democratic states do not fight interstate wars against each other is one of the most enduring and influential ideas in international relations. The idea is theoretically rooted in the work of Immanuel Kant, who argued that interactions between states with a republican form of government give “a favorable prospect for the desired consequence, i.e., perpetual peace.”1 This has led to a large literature empirically documenting a negative association between democracy and conflict,2 leading one scholar to comment that the democratic peace is “the closest thing we have to an empirical law in the study of international relations.”3
Despite the law-like nature of this association, no scholarly consensus has emerged on whether the observed association reflects a causal relationship or a spurious correlation. According to a recent survey, more than 30 percent of international relations scholars disagree with the democratic peace theory.4 In particular, skeptics have challenged the democratic peace by arguing that alliance structures from the Cold War,5 capitalism,6 and contract-intensive economies7 confound the observed association. These authors find that adding certain confounding variables to regression models eliminates the statistical significance of the estimated coefficient for the joint democracy variable.8
How should we resolve this empirical debate regarding the democratic peace?9 Unfortunately, in the absence of randomized experiments, we can never completely rule out the possible existence of confounding biases that arise from omitted variables. While scholars in this literature have exclusively relied on parametric regression models, this approach requires strong assumptions, namely that the model accurately characterizes the true data-generating process (correct set of variables, right functional form, valid distributional assumption, etc.). Given that these assumptions may not be verifiable from observed data, it is no surprise that various scholars advocate different regression models with diverging sets of variables, resulting in contradictory findings. The difficulty of adjudicating between these alternative modeling approaches has led to the ongoing controversy in the empirical democratic peace literature.
We propose an alternative approach based on nonparametric sensitivity analysis to formally assess the robustness of the empirical evidence.10 Specifically, we quantify the strength of confounding relationships that could explain away the observed association between democracy and peace. That is, we compute the precise level of unobserved confounding needed to render the observed association between democracy and conflict spurious. The idea is that although not all correlations imply causation, a very strong correlation suggests it. Unlike the parametric regression modeling approach prevalent in the literature, the proposed nonparametric sensitivity approach directly addresses the existence of unobserved confounders without assuming a particular regression model.11 Although one can never know with certainty from observational data whether democracy causes peace, this nonparametric sensitivity analysis can formally assess the robustness of empirical evidence for the democratic peace.
Our analysis applies the nonparametric sensitivity analysis method originally developed by Cornfield and colleagues, who were concerned with the robustness of the positive association between cigarette smoking and lung cancer in the potential presence of unobserved confounders.12 The study of the causal relationship between smoking and lung cancer closely parallels the dispute on the democratic peace. In both cases, randomized experiments cannot be conducted for ethical and logistical reasons, and critics contend that the observed association suffers from confounding biases. While no definitive conclusion can be drawn from observational data, Cornfield and colleagues argue that no existing confounder can explain the strong association between smoking and cancer and therefore this relationship is likely to be causal. Their conclusion is worth quoting here: Cigarette smokers have a ninefold greater risk of developing lung cancer than nonsmokers, while over-two-pack-a-day smokers have at least a 60-fold greater risk. Any characteristic proposed as a measure of the postulated cause common to both smoking status and lung-cancer risk must therefore be at least nine-fold more prevalent among cigarette smokers than among nonsmokers and at least 60-fold more prevalent among two-pack-a-day smokers. No such characteristic has yet been produced despite diligent search.13
Our application of nonparametric sensitivity analysis to the democratic peace yields striking results. Depending on the definition of democracy, we find that a confounder must be at least forty-seven times more prevalent in democratic dyads than in other types of dyads. Thus, any potential confounder that could explain the democratic peace would have to be at least five times as prevalent as a similar confounder for smoking and lung cancer. In other words, according to our analysis, the positive association between democracy and peace is much more robust than that between smoking and lung cancer.
While no such confounder has yet been found for the relationship between smoking and lung cancer, we examine whether the confounders identified in the democratic peace literature meet the conditions of nonparametric sensitivity analysis. For example, we consider a set of economic confounders proposed by Gartzke who argues that the democratic peace can be explained by capitalism.14 We also consider other confounders, such as military alliances.15 Overall, our findings imply that for a potential confounder to explain away the democratic peace, it must be much more strongly associated with regime types and conflicts than the confounders that have been proposed to date. This finding again demonstrates the robustness of empirical evidence for the democratic peace.
Finally, we believe that a nonparametric sensitivity analysis, such as the one we use here, can play an important role in international relations research, where the threat of omitted variable bias is almost always present. Although sensitivity analysis has been applied in international relations, almost all such applications have been based on parametric regression models. In the democratic peace literature, Kadera and Mitchell conduct a parametric sensitivity analysis in the spirit of Leamer.16 In addition, Chaudoin, Hays, and Hicks apply a parametric sensitivity analysis of Altonji, Elder, and Taber to the effects of the GATT/WTO, whereas Hegre and Sambanis use the method of Sala-i-Martin to examine the sensitivity of empirical results on civil war onset.17 The only exception we found is Davis and Shirato, who use a nonparametric sensitivity analysis to assess the robustness of their findings to possible sample selection bias.18 Unlike parametric approaches, nonparametric sensitivity analyses avoid modeling assumptions and hence offer a robust method to examine the strength of empirical conclusions.