Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Their randomized studies don’t cut it

Imai '21 - Professor of Government and of Statistics at Harvard University [Kosuke and James Lo, "Robustness of Empirical Evidence for the Democratic Peace: A Nonparametric Sensitivity Analysis," International Organization, Vol 75, Issue 3]

Unobserved confounding in observational research is one of the most fundamental methodological problems in social science. Although the randomization of treatments enables the identification of causal effects, such randomization is rarely feasible in many areas of social science, including political science. In such circumstances, different assumptions can yield conflicting results and yet it is impossible to assess the validity of competing assumptions. As a result, scholarly debates often end up in a scientific deadlock in which neither side is able to provide convincing evidence.

We believe that sensitivity analysis can play an essential role in making scientific progress in these difficult situations. While it cannot draw a definitive conclusion about causal relationships, sensitivity analysis allows researchers to evaluate the robustness of empirical findings by quantifying the minimum strength of unobserved confounding that must exist to explain away an observed association. An open-source software package, Evalue, is available for implementing the sensitivity analysis used here.Footnote58

Sign in to recut, update, or save this card.