Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Absent that, bioterrorism causes extinction – that infinitely outweighs

Piers Millett* & Andrew Snyder-Beattie** 2017. *Senior Research Fellow at the Future of Humanity Institute, where he focuses on pandemic and deliberate disease and the implications of biotechnology. **Leads Open Philanthropy’s work on biosecurity and pandemic preparedness. He previously spent five years at the Future of Humanity Institute (University of Oxford), where he worked as a program manager and later as Director of Research, developing programs across the institute including those in biosecurity and systemic risk. “Existential Risk and Cost-Effective Biosecurity.” Health Secur. 2017 Aug 1; 15(4): 373–383. August 1, 2017, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5576214/ IZP)

How worthwhile is it spending resources to study and mitigate the chance of human extinction from biological risks? The risks of such a catastrophe are presumably low, so a skeptic might argue that addressing such risks would be a waste of scarce resources. In this article, we investigate this position using a cost-effectiveness approach and ultimately conclude that the expected value of reducing these risks is large, especially since such risks jeopardize the existence of all future human lives. Historically, disease events have been responsible for the greatest death tolls on humanity. The 1918 flu was responsible for more than 50 million deaths,1 while smallpox killed perhaps 10 times that many in the 20th century alone.2 The Black Death was responsible for killing over 25% of the European population,3 while other pandemics, such as the plague of Justinian, are thought to have killed 25 million in the 6th century—constituting over 10% of the world's population at the time.4 It is an open question whether a future pandemic could result in outright human extinction or the irreversible collapse of civilization. A skeptic would have many good reasons to think that existential risk from disease is unlikely. Such a disease would need to spread worldwide to remote populations, overcome rare genetic resistances, and evade detection, cures, and countermeasures. Even evolution itself may work in humanity's favor: Virulence and transmission is often a trade-off, and so evolutionary pressures could push against maximally lethal wild-type pathogens.5,6 While these arguments point to a very small risk of human extinction, they do not rule the possibility out entirely. Although rare, there are recorded instances of species going extinct due to disease—primarily in amphibians, but also in 1 mammalian species of rat on Christmas Island.7,8 There are also historical examples of large human populations being almost entirely wiped out by disease, especially when multiple diseases were simultaneously introduced into a population without immunity. The most striking examples of total population collapse include native American tribes exposed to European diseases, such as the Massachusett (86% loss of population), Quiripi-Unquachog (95% loss of population), and the Western Abenaki (which suffered a staggering 98% loss of population).9 In the modern context, no single disease currently exists that combines the worst-case levels of transmissibility, lethality, resistance to countermeasures, and global reach. But many diseases are proof of principle that each worst-case attribute can be realized independently. For example, some diseases exhibit nearly a 100% case fatality ratio in the absence of treatment, such as rabies or septicemic plague. Other diseases have a track record of spreading to virtually every human community worldwide, such as the 1918 flu,10 and seroprevalence studies indicate that other pathogens, such as chickenpox and HSV-1, can successfully reach over 95% of a population.11,12 Under optimal virulence theory, natural evolution would be an unlikely source for pathogens with the highest possible levels of transmissibility, virulence, and global reach. But advances in biotechnology might allow the creation of diseases that combine such traits. Recent controversy has already emerged over a number of scientific experiments that resulted in viruses with enhanced transmissibility, lethality, and/or the ability to overcome therapeutics.13-17 Other experiments demonstrated that mousepox could be modified to have a 100% case fatality rate and render a vaccine ineffective.18 In addition to transmissibility and lethality, studies have shown that other disease traits, such as incubation time, environmental survival, and available vectors, could be modified as well.19-21 Although these experiments had scientific merit and were not conducted with malicious intent, their implications are still worrying. This is especially true given that there is also a long historical track record of state-run bioweapon research applying cutting-edge science and technology to design agents not previously seen in nature. The Soviet bioweapons program developed agents with traits such as enhanced virulence, resistance to therapies, greater environmental resilience, increased difficulty to diagnose or treat, and which caused unexpected disease presentations and outcomes.22 Delivery capabilities have also been subject to the cutting edge of technical development, with Canadian, US, and UK bioweapon efforts playing a critical role in developing the discipline of aerobiology.23,24 While there is no evidence of state-run bioweapons programs directly attempting to develop or deploy bioweapons that would pose an existential risk, the logic of deterrence and mutually assured destruction could create such incentives in more unstable political environments or following a breakdown of the Biological Weapons Convention.25 The possibility of a war between great powers could also increase the pressure to use such weapons—during the World Wars, bioweapons were used across multiple continents, with Germany targeting animals in WWI,26 and Japan using plague to cause an epidemic in China during WWII.27 Non-state actors may also pose a risk, especially those with explicitly omnicidal aims. While rare, there are examples. The Aum Shinrikyo cult in Japan sought biological weapons for the express purpose of causing extinction.28 Environmental groups, such as the Gaia Liberation Front, have argued that “we can ensure Gaia's survival only through the extinction of the Humans as a species … we now have the specific technology for doing the job … several different [genetically engineered] viruses could be released”(quoted in ref. 29). Groups such as R.I.S.E. also sought to protect nature by destroying most of humanity with bioweapons.30 Fortunately, to date, non-state actors have lacked the capabilities needed to pose a catastrophic bioweapons threat, but this could change in future decades as biotechnology becomes more accessible and the pool of experienced users grows.31,32 What is the appropriate response to these speculative extinction threats? A balanced biosecurity portfolio might include investments that reduce a mix of proven and speculative risks, but striking this balance is still difficult given the massive uncertainties around the low-probability, high-consequence risks. In this article, we examine the traditional spectrum of biosecurity risks (ie, biocrimes, bioterrorism, and biowarfare) to categorize biothreats by likelihood and impact, expanding the historical analysis to consider even lower-probability, higher-consequence events (catastrophic risks and existential risks). In order to produce reasoned estimates of the likelihood of different categories of biothreats, we bring together relevant data and theory and produce some first-guess estimates of the likelihood of different categories of biothreat, and we use these initial estimates to compare the cost-effectiveness of reducing existential risks with more traditional biosecurity measures. We emphasize that these models are highly uncertain, and their utility lies more in enabling order-of-magnitude comparisons rather than as a precise measure of the true risk. However, even with the most conservative models, we find that reduction of low-probability, high-consequence risks can be more cost-effective, as measured by quality-adjusted life year per dollar, especially when we account for the lives of future generations. This suggests that despite the low probability of such events, society still ought to invest more in preventing the most extreme possible biosecurity catastrophes The Impact Spectrum of Various Biothreats Here, we use historical data to analyze the probability and severity of biothreats. We place biothreats in 6 loose categories: incidents, events, disasters, crises, global catastrophic risk, and existential risk. Together they form an overlapping spectrum of increasing impact and decreasing likelihood (Figure 1). (Figure 1 omitted) The historical use of bioweapons provides useful examples of some categories of biothreats. Biocrimes and bioterrorism provide examples of incidents.† Biological warfare provides examples of events and disasters. These historical examples provide indicative data on likelihood and impact that we can then feed into a cost-effectiveness analysis. We should note that these data are both sparse and sometimes controversial. Where possible, we use multiple datasets to corroborate our numbers, but ultimately the “true rate” of bioweapon attacks is highly uncertain. Biocrimes and Bioterrorism Historically, risks of biocrime‡ and bioterrorism§ have been limited. A 2015 Risk and Benefit Analysis for Gain of Function Research detailed 24 biocrimes between 1990 and 2015 (0.96 per year) and an additional 42 bioterrorism incidents between 1972 and 2014 (1 per year).36 This is consistent with other estimates of biocrimes and bioterrorism frequency, which range from 0.35 to 3.5 per year (see supplementary material, part 1, at http://online.liebertpub.com/doi/suppl/10.1089/hs.2017.0028). Most attacks typically result in no more than a handful of casualties (and many of these events include hoaxes, threats, and attacks that had no casualties at all). For example, the anthrax letter attacks in the United States in 2001, perhaps the most high-profile case in recent years, resulted in only 17 infections with 5 fatalities.37 The 2015 Risk and Benefit Analysis for Gain of Function Research detailed only a single death from the recorded biocrimes.** Only 1 of the bioterrorism incidents in the report had associated deaths (the 2001 anthrax letter attacks).36 Based on this data, for the purposes of this article, we assume that we could expect 1 incident per year resulting in up to tens of deaths. Biological Warfare Academic overviews of biological warfare†† detail 7 programs prior to 1945.38 A further 9 programs are recorded between 1945 and 1994.39 For most of the last century, at least 1 program was active in any given year (Table 1). (Table 1 omitted) The actual use of bioweapons by states is less common: Over the 85 years covered by these histories (1915 to 2000), 18 cases of use (or possible use) were recorded, including outbreaks connected to biological warfare (see supplementary material, part 2, at http://online.liebertpub.com/doi/suppl/10.1089/hs.2017.0028). Extrapolating this out (dividing 18 by 85), we would have about a 20% chance per year of biowarfare. It is worth noting the limitations of these data. Most of these events occurred before the introduction of the Biological Weapons Convention and were conducted by countries that no longer have biological weapons programs. Since many of these incidents occurred during infrequent great power wars, we revise our best guess to around 10% chance per year of biowarfare. We use 2 sets of data to estimate the magnitude of such events. The first dataset was Japanese biological warfare in China,40 where records indicate a series of attacks on towns resulted in a mean of 330 casualties per event and 1 case in which an attack resulted in a regional outbreak causing an estimated 30,000 deaths (see supplementary material, part 3, at http://online.liebertpub.com/doi/suppl/10.1089/hs.2017.0028). The second data set came from disease events that were alleged to have an unnatural origin.41 In one case study, a point source release of anthrax resulted in at least 66 deaths. In a second case study, a regional epidemic of the same disease resulted in more than 17,000 human cases. While these events were not confirmed as having been caused by biological warfare, contemporary or subsequent analysis has suggested that such an origin was at least feasible. Combined, these figures provide an estimated impact of between 66 to 330 and 17,000 to 30,000. For the purposes of this analysis, we are assuming the lower boundary figures from biological warfare are indicative of events, with a likelihood of 10% per year and an impact ranging between tens and thousands of fatalities. The upper boundary figures from biological warfare are indicative of disasters, with a likelihood of 1% per year and an impact range of thousands to tens of thousands of fatalities.‡‡ Go to: Global Catastrophic and Existential Risk Unlike standard biothreats, there is no historical record on which to draw when considering global catastrophic or existential risks. Alternative approaches are required to estimate the likelihood of such an event. Given the high degree of uncertainty, we adopt 3 different approaches to approximate the risk of extinction from bioweapons: utilizing surveys of experts, previous major risk assessments, and simple toy models. These should be taken as initial guesses or rough order-of-magnitude approximations, and not a reliable or precise measure. Model 1: Survey of 2008 Global Catastrophic Risk Conference An informal survey at the 2008 Oxford Global Catastrophic Risk Conference asked participants to estimate the chance that disasters of different types would occur before 2100. Participants had a median risk estimate of 0.05% that a natural pandemic would lead to human extinction by 2100, and a median risk estimate of 2% that an “engineered” pandemic would lead to extinction by 2100.42 The advantage of the survey is that it directly measures the quantity that we are interested in: probability of extinction from bioweapons. The disadvantage is that the estimates were likely highly subjective and unreliable, especially as the survey did not account for response bias, and the respondents were not calibrated beforehand. We therefore also turn to other models that, while indirect, provide more objective measures of risk.§§ Model 2: Potentially Pandemic Pathogens Recent controversial experiments on H5N1 influenza prompted discussions as to the risks of deliberately creating potentially pandemic pathogens. These agents are those that are highly transmissible, capable of uncontrollable spread in human populations, highly virulent, and also possibly able to overcome medical countermeasures.44 Previous work in a comprehensive report done by Gryphon Scientific, Risk and Benefit Analysis of Gain of Function Research,36 has laid out very detailed risk assessments of potentially pandemic pathogen research, suggesting that the annual probability of a global pandemic resulting from an accident with this type of research in the United States is 0.002% to 0.1%. The report also concluded that risks of deliberate misuse were about as serious as the risks of an accidental outbreak, suggesting a 2-fold increase in risk. Assuming that 25% of relevant research is done in the United States as opposed to elsewhere in the world, this gives us a further 4-fold increase in risk. In total, this 8-fold increase in risk gives us a 0.016% to 0.8% chance of a pandemic in the future each year (see supplementary material, part 4, at http://online.liebertpub.com/doi/suppl/10.1089/hs.2017.0028). The analysis in Risk and Benefit Analysis of Gain of Function Research suggested that lab outbreaks from wild-type influenza viruses could result in between 4 million and 80 million deaths,36 but others have suggested that if some of the modified pathogens were to escape from a laboratory, they could cause up to 1 billion fatalities.45 For the purposes of this model, we assume that for any global pandemic arising from this kind of research, each has only a 1 in 10,000*** chance of causing an existential risk. This figure is somewhat arbitrary but serves as an excessively conservative guess that would include worst-case situations in which scientists intentionally cause harm, where civilization permanently collapses following a particularly bad outbreak, or other worst-case scenarios that would result in existential risk. Multiplying the probability of an outbreak with the probability of an existential risk gives us an annual risk probability between 1.6 × 10–8 and 8 × 10–7.††† Model 3: Naive Power Law Extrapolation Previous literature has found that casualty numbers from terrorism and warfare follow a power law distribution, including terrorism from WMDs.46 Power laws have the property of being scale invariant, meaning that the ratio in likelihood between events that cause the deaths of 10 people and 10,000 people will be the same as that between 10,000 people and 10,000,000 people.‡‡‡ This property results in a distribution with an exceptionally heavy tail, so that the vast majority of events will have very low casualty rates, with a couple of extreme outliers. Past studies have estimated this ratio for terrorism using biological and chemical weapons to be about 0.5 for 1 order of magnitude,47 meaning that an attack that kills 10x people is about 3 times less likely (100.5) than an attack that kills 10x–1 people (a concrete example is that attacks with more than 1,000 casualties, such as the Aum Shinrikyo attacks, will be about 30 times less probable than an attack that kills a single individual). Extrapolating the power law out, we find that the probability that an attack kills more than 5 billion will be (5 billion)–0.5 or 0.000014. Assuming 1 attack per year (extrapolated on the current rate of bio-attacks) and assuming that only 10% of such attacks that kill more than 5 billion eventually lead to extinction (due to the breakdown of society, or other knock-on effects), we get an annual existential risk of 0.0000014 (or 1.4 × 10–6). We can also use similar reasoning for warfare, where we have more reliable data (97 wars between 1820 and 1997, although the data are less specific to biological warfare). The parameter for warfare is 0.41,47 suggesting that wars that result in more than 5 billion casualties will comprise (5 billion)–0.41 = 0.0001 of all wars. Our estimate assumes that wars will occur with the same frequency as in 1820 to 1997, with 1 new war arising roughly every 2 years. It also assumes that in these extreme outlier scenarios, nuclear or contagious biological weapons would be the cause of such high casualty numbers, and that bioweapons specifically would be responsible for these enormous casualties about 10% of the time (historically bioweapons were deployed in WWI, WWII, and developed but not deployed in the Cold War—constituting a bioweapons threat in every great power war since 1900). Assuming that 10% of biowarfare escalations resulting in more than 5 billion deaths eventually lead to extinction, we get an annual existential risk from biowarfare of 0.0000005 (or 5 × 10–7). Perhaps the most interesting implication of the fatalities following a power law with a small exponent is that the majority of the expected casualties come from rare, catastrophic events. The data also bear this out for warfare and terrorism. The vast majority of US terrorism deaths occurred during 9/11, and the vast majority of terrorism injuries in Japan over the past decades came from a single Aum Shinrikyo attack. Warfare casualties are dominated by the great power wars. This suggests that a typical individual is far more likely to die from a rare, catastrophic attack as opposed to a smaller scale and more common one. If our goal is to reduce the greatest expected number of fatalities, we may be better off devoting resources to preventing the worst possible attacks. Why Uncertainty Is Not Cause for Reassurance Each of our estimates rely to some extent on guesswork and remain highly uncertain. Technological breakthroughs in areas such as diagnostics, vaccines, and therapeutics, as well as vastly improved surveillance, or even eventual space colonization, could reduce the chance of disease-related extinction by many orders of magnitude. Other breakthroughs such as highly distributed DNA synthesis or improved understanding of how to construct and modify diseases could increase or decrease the risks. Destabilizing political forces, the breakdown of the Biological Weapons Convention, or warfare between major world powers could vastly increase the amount of investment in bioweapons and create the incentives to actively use knowledge and biotechnology in destructive ways. Each of these factors suggests that our wide estimates could still be many orders of magnitude off from the true risk in this century. But uncertainty is not cause for reassurance. In instances where the probability of a catastrophe is thought to be extremely low (eg, human extinction from bioweapons), greater uncertainty around the estimates will typically imply greater risk of the catastrophe, as we have reduced confidence that the risk is actually at a low level.48 §§§ Given that our conservative models are based on historical data, they fail to account for the primary source of future risk: technological development that could radically democratize the ability to build advanced bioweapons. If the cost and required expertise of developing bioweapons falls far enough, the world might enter a phase where offensive capabilities dominate defensive ones. Some scholars, such as Martin Rees, think that humanity has about a 50% chance of going extinct due in large part to such technologies.49 However, incorporating these intuitions and technological conjectures would mean relying on qualitative arguments that would be far more contentious than our conservative estimates. We therefore proceed to assess the cost-effectiveness on the basis of our conservative models, until superior models of the risk emerge. How Bad Would Human Extinction Be? Human extinction would not only end the 7 billion lives in our current generation, but also cause the loss of all future generations to come. To calculate the humanitarian cost associated with such a catastrophe, one must therefore include the welfare of these future generations. While some have argued that future generations ought to be excluded or discounted when considering ethical actions,50 most of the in-depth philosophical work around the topic has concluded that future generations should not be given less inherent value.51-55 Therefore, for our calculations, we include future lives in our cost-effectiveness estimate.**** The large number of future generations at stake mean that reducing existential risk even by a small amount may have very large expected value. The Earth is thought to be habitable for roughly another billion years;56 our closest relative, homo erectus, lasted over 1.6 million years,57 and the typical mammalian species also lasts on the order of 1 to 2 million years.58 Following Matheny,29 if we were to assume that humanity would otherwise maintain a global population of 10 billion for the next 1.6 million years, human extinction would jeopardize on the order of 1.6 × 10^16 life years.

Sign in to recut, update, or save this card.