Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

DPT is an empirical law---prices in confounding variables

Imai 21 — Kosuke Imai is Professor of Government and of Statistics at Harvard University. Imai, K., & Lo, J. (2021). Robustness of Empirical Evidence for the Democratic Peace: A Nonparametric Sensitivity Analysis. International Organization, 75(3), 901-919. doi:10.1017/S0020818321000126 WMK

The proposition that democratic states do not fight interstate wars against each other is one of the most enduring and influential ideas in international relations. The idea is theoretically rooted in the work of Immanuel Kant, who argued that interactions between states with a republican form of government give “a favorable prospect for the desired consequence, i.e., perpetual peace.”Footnote1 This has led to a large literature empirically documenting a negative association between democracy and conflict,Footnote2 leading one scholar to comment that the democratic peace is “the closest thing we have to an empirical law in the study of international relations.”Footnote3

Despite the law-like nature of this association, no scholarly consensus has emerged on whether the observed association reflects a causal relationship or a spurious correlation. According to a recent survey, more than 30 percent of international relations scholars disagree with the democratic peace theory.Footnote4 In particular, skeptics have challenged the democratic peace by arguing that alliance structures from the Cold War,Footnote5 capitalism,Footnote6 and contract-intensive economiesFootnote7 confound the observed association. These authors find that adding certain confounding variables to regression models eliminates the statistical significance of the estimated coefficient for the joint democracy variable.Footnote8

How should we resolve this empirical debate regarding the democratic peace?Footnote9 Unfortunately, in the absence of randomized experiments, we can never completely rule out the possible existence of confounding biases that arise from omitted variables. While scholars in this literature have exclusively relied on parametric regression models, this approach requires strong assumptions, namely that the model accurately characterizes the true data-generating process (correct set of variables, right functional form, valid distributional assumption, etc.). Given that these assumptions may not be verifiable from observed data, it is no surprise that various scholars advocate different regression models with diverging sets of variables, resulting in contradictory findings. The difficulty of adjudicating between these alternative modeling approaches has led to the ongoing controversy in the empirical democratic peace literature.

We propose an alternative approach based on nonparametric sensitivity analysis to formally assess the robustness of the empirical evidence.Footnote10 Specifically, we quantify the strength of confounding relationships that could explain away the observed association between democracy and peace. That is, we compute the precise level of unobserved confounding needed to render the observed association between democracy and conflict spurious. The idea is that although not all correlations imply causation, a very strong correlation suggests it. Unlike the parametric regression modeling approach prevalent in the literature, the proposed nonparametric sensitivity approach directly addresses the existence of unobserved confounders without assuming a particular regression model.Footnote11 Although one can never know with certainty from observational data whether democracy causes peace, this nonparametric sensitivity analysis can formally assess the robustness of empirical evidence for the democratic peace.

Our analysis applies the nonparametric sensitivity analysis method originally developed by Cornfield and colleagues, who were concerned with the robustness of the positive association between cigarette smoking and lung cancer in the potential presence of unobserved confounders.Footnote12 The study of the causal relationship between smoking and lung cancer closely parallels the dispute on the democratic peace. In both cases, randomized experiments cannot be conducted for ethical and logistical reasons, and critics contend that the observed association suffers from confounding biases. While no definitive conclusion can be drawn from observational data, Cornfield and colleagues argue that no existing confounder can explain the strong association between smoking and cancer and therefore this relationship is likely to be causal. Their conclusion is worth quoting here:

Cigarette smokers have a ninefold greater risk of developing lung cancer than nonsmokers, while over-two-pack-a-day smokers have at least a 60-fold greater risk. Any characteristic proposed as a measure of the postulated cause common to both smoking status and lung-cancer risk must therefore be at least nine-fold more prevalent among cigarette smokers than among nonsmokers and at least 60-fold more prevalent among two-pack-a-day smokers. No such characteristic has yet been produced despite diligent search.Footnote13

Our application of nonparametric sensitivity analysis to the democratic peace yields striking results. Depending on the definition of democracy, we find that a confounder must be at least forty-seven times more prevalent in democratic dyads than in other types of dyads. Thus, any potential confounder that could explain the democratic peace would have to be at least five times as prevalent as a similar confounder for smoking and lung cancer. In other words, according to our analysis, the positive association between democracy and peace is much more robust than that between smoking and lung cancer.

While no such confounder has yet been found for the relationship between smoking and lung cancer, we examine whether the confounders identified in the democratic peace literature meet the conditions of nonparametric sensitivity analysis. For example, we consider a set of economic confounders proposed by Gartzke who argues that the democratic peace can be explained by capitalism.Footnote14 We also consider other confounders, such as military alliances.Footnote15 Overall, our findings imply that for a potential confounder to explain away the democratic peace, it must be much more strongly associated with regime types and conflicts than the confounders that have been proposed to date. This finding again demonstrates the robustness of empirical evidence for the democratic peace.

Sign in to recut, update, or save this card.