Opening Word document…

Multiple actors are seeking existential bioweapons – only a strong pharma industry can stop them

Millett and Snyder-Beattie 17 [Piers Millett; PhD and Executive Director at the International Biosecurity & Biosafety Initiative for Science (IBBIS); Andrew Snyder-Beattie; PhD in Philosophy and Zoology and MS in Biomathematics; 8-1-17; "Existential Risk and Cost-Effective Biosecurity"; PubMed Central (PMC); https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5576214/; Accessed 7-5-2023; AW] *brackets were there in the article

Although these experiments had scientific merit and were not conducted with malicious intent, their implications are still worrying. This is especially true given that there is also a long historical track record of state-run bioweapon research applying cutting-edge science and technology to design agents not previously seen in nature. The Soviet bioweapons program developed agents with traits such as enhanced virulence, resistance to therapies, greater environmental resilience, increased difficulty to diagnose or treat, and which caused unexpected disease presentations and outcomes.22 Delivery capabilities have also been subject to the cutting edge of technical development, with Canadian, US, and UK bioweapon efforts playing a critical role in developing the discipline of aerobiology.23,24 While there is no evidence of state-run bioweapons programs directly attempting to develop or deploy bioweapons that would pose an existential risk, the logic of deterrence and mutually assured destruction could create such incentives in more unstable political environments or following a breakdown of the Biological Weapons Convention.25 The possibility of a war between great powers could also increase the pressure to use such weapons—during the World Wars, bioweapons were used across multiple continents, with Germany targeting animals in WWI,26 and Japan using plague to cause an epidemic in China during WWII.27 Non-state actors may also pose a risk, especially those with explicitly omnicidal aims. While rare, there are examples. The Aum Shinrikyo cult in Japan sought biological weapons for the express purpose of causing extinction.28 Environmental groups, such as the Gaia Liberation Front, have argued that “we can ensure Gaia's survival only through the extinction of the Humans as a species … we now have the specific technology for doing the job … several different [genetically engineered] viruses could be released”(quoted in ref. 29). Groups such as R.I.S.E. also sought to protect nature by destroying most of humanity with bioweapons.30 Fortunately, to date, non-state actors have lacked the capabilities needed to pose a catastrophic bioweapons threat, but this could change in future decades as biotechnology becomes more accessible and the pool of experienced users grows. What is the appropriate response to these speculative extinction threats? A balanced biosecurity portfolio might include investments that reduce a mix of proven and speculative risks, but striking this balance is still difficult given the massive uncertainties around the low-probability, high-consequence risks. In this article, we examine the traditional spectrum of biosecurity risks (ie, biocrimes, bioterrorism, and biowarfare) to categorize biothreats by likelihood and impact, expanding the historical analysis to consider even lower-probability, higher-consequence events (catastrophic risks and existential risks). In order to produce reasoned estimates of the likelihood of different categories of biothreats, we bring together relevant data and theory and produce some first-guess estimates of the likelihood of different categories of biothreat, and we use these initial estimates to compare the cost-effectiveness of reducing existential risks with more traditional biosecurity measures. We emphasize that these models are highly uncertain, and their utility lies more in enabling order-of-magnitude comparisons rather than as a precise measure of the true risk. However, even with the most conservative models, we find that reduction of low-probability, high-consequence risks can be more cost-effective, as measured by quality-adjusted life year per dollar, especially when we account for the lives of future generations. This suggests that despite the low probability of such events, society still ought to invest more in preventing the most extreme possible biosecurity catastrophes. The Impact Spectrum of Various Biothreats Here, we use historical data to analyze the probability and severity of biothreats. We place biothreats in 6 loose categories: incidents, events, disasters, crises, global catastrophic risk, and existential risk. Together they form an overlapping spectrum of increasing impact and decreasing likelihood (Figure 1).* [Figure 1 omitted] The historical use of bioweapons provides useful examples of some categories of biothreats. Biocrimes and bioterrorism provide examples of incidents.† Biological warfare provides examples of events and disasters. These historical examples provide indicative data on likelihood and impact that we can then feed into a cost-effectiveness analysis. We should note that these data are both sparse and sometimes controversial. Where possible, we use multiple datasets to corroborate our numbers, but ultimately the “true rate” of bioweapon attacks is highly uncertain. Biocrimes and Bioterrorism Historically, risks of biocrime‡ and bioterrorism§ have been limited. A 2015 Risk and Benefit Analysis for Gain of Function Research detailed 24 biocrimes between 1990 and 2015 (0.96 per year) and an additional 42 bioterrorism incidents between 1972 and 2014 (1 per year).36 This is consistent with other estimates of biocrimes and bioterrorism frequency, which range from 0.35 to 3.5 per year (see supplementary material, part 1, at http://online.liebertpub.com/doi/suppl/10.1089/hs.2017.0028). Most attacks typically result in no more than a handful of casualties (and many of these events include hoaxes, threats, and attacks that had no casualties at all). For example, the anthrax letter attacks in the United States in 2001, perhaps the most high-profile case in recent years, resulted in only 17 infections with 5 fatalities.37 The 2015 Risk and Benefit Analysis for Gain of Function Research detailed only a single death from the recorded biocrimes.** Only 1 of the bioterrorism incidents in the report had associated deaths (the 2001 anthrax letter attacks).36 Based on this data, for the purposes of this article, we assume that we could expect 1 incident per year resulting in up to tens of deaths. Biological Warfare Academic overviews of biological warfare†† detail 7 programs prior to 1945.38 A further 9 programs are recorded between 1945 and 1994.39 For most of the last century, at least 1 program was active in any given year (Table 1). [Table 1 omitted] The actual use of bioweapons by states is less common: Over the 85 years covered by these histories (1915 to 2000), 18 cases of use (or possible use) were recorded, including outbreaks connected to biological warfare (see supplementary material, part 2, at http://online.liebertpub.com/doi/suppl/10.1089/hs.2017.0028). Extrapolating this out (dividing 18 by 85), we would have about a 20% chance per year of biowarfare. It is worth noting the limitations of these data. Most of these events occurred before the introduction of the Biological Weapons Convention and were conducted by countries that no longer have biological weapons programs. Since many of these incidents occurred during infrequent great power wars, we revise our best guess to around 10% chance per year of biowarfare. We use 2 sets of data to estimate the magnitude of such events. The first dataset was Japanese biological warfare in China,40 where records indicate a series of attacks on towns resulted in a mean of 330 casualties per event and 1 case in which an attack resulted in a regional outbreak causing an estimated 30,000 deaths (see supplementary material, part 3, at http://online.liebertpub.com/doi/suppl/10.1089/hs.2017.0028). The second data set came from disease events that were alleged to have an unnatural origin.41 In one case study, a point source release of anthrax resulted in at least 66 deaths. In a second case study, a regional epidemic of the same disease resulted in more than 17,000 human cases. While these events were not confirmed as having been caused by biological warfare, contemporary or subsequent analysis has suggested that such an origin was at least feasible. Combined, these figures provide an estimated impact of between 66 to 330 and 17,000 to 30,000. For the purposes of this analysis, we are assuming the lower boundary figures from biological warfare are indicative of events, with a likelihood of 10% per year and an impact ranging between tens and thousands of fatalities. The upper boundary figures from biological warfare are indicative of disasters, with a likelihood of 1% per year and an impact range of thousands to tens of thousands of fatalities.‡‡ Global Catastrophic and Existential Risk Unlike standard biothreats, there is no historical record on which to draw when considering global catastrophic or existential risks. Alternative approaches are required to estimate the likelihood of such an event. Given the high degree of uncertainty, we adopt 3 different approaches to approximate the risk of extinction from bioweapons: utilizing surveys of experts, previous major risk assessments, and simple toy models. These should be taken as initial guesses or rough order-of-magnitude approximations, and not a reliable or precise measure. Model 1: Survey of 2008 Global Catastrophic Risk Conference An informal survey at the 2008 Oxford Global Catastrophic Risk Conference asked participants to estimate the chance that disasters of different types would occur before 2100. Participants had a median risk estimate of 0.05% that a natural pandemic would lead to human extinction by 2100, and a median risk estimate of 2% that an “engineered” pandemic would lead to extinction by 2100.42 The advantage of the survey is that it directly measures the quantity that we are interested in: probability of extinction from bioweapons. The disadvantage is that the estimates were likely highly subjective and unreliable, especially as the survey did not account for response bias, and the respondents were not calibrated beforehand. We therefore also turn to other models that, while indirect, provide more objective measures of risk.§§ Model 2: Potentially Pandemic Pathogens Recent controversial experiments on H5N1 influenza prompted discussions as to the risks of deliberately creating potentially pandemic pathogens. These agents are those that are highly transmissible, capable of uncontrollable spread in human populations, highly virulent, and also possibly able to overcome medical countermeasures.44 Previous work in a comprehensive report done by Gryphon Scientific, Risk and Benefit Analysis of Gain of Function Research,36 has laid out very detailed risk assessments of potentially pandemic pathogen research, suggesting that the annual probability of a global pandemic resulting from an accident with this type of research in the United States is 0.002% to 0.1%. The report also concluded that risks of deliberate misuse were about as serious as the risks of an accidental outbreak, suggesting a 2-fold increase in risk. Assuming that 25% of relevant research is done in the United States as opposed to elsewhere in the world, this gives us a further 4-fold increase in risk. In total, this 8-fold increase in risk gives us a 0.016% to 0.8% chance of a pandemic in the future each year (see supplementary material, part 4, at http://online.liebertpub.com/doi/suppl/10.1089/hs.2017.0028). The analysis in Risk and Benefit Analysis of Gain of Function Research suggested that lab outbreaks from wild-type influenza viruses could result in between 4 million and 80 million deaths,36 but others have suggested that if some of the modified pathogens were to escape from a laboratory, they could cause up to 1 billion fatalities.45 For the purposes of this model, we assume that for any global pandemic arising from this kind of research, each has only a 1 in 10,000*** chance of causing an existential risk. This figure is somewhat arbitrary but serves as an excessively conservative guess that would include worst-case situations in which scientists intentionally cause harm, where civilization permanently collapses following a particularly bad outbreak, or other worst-case scenarios that would result in existential risk. Multiplying the probability of an outbreak with the probability of an existential risk gives us an annual risk probability between 1.6 × 10–8 and 8 × 10–7.††† Model 3: Naive Power Law Extrapolation Previous literature has found that casualty numbers from terrorism and warfare follow a power law distribution, including terrorism from WMDs.46 Power laws have the property of being scale invariant, meaning that the ratio in likelihood between events that cause the deaths of 10 people and 10,000 people will be the same as that between 10,000 people and 10,000,000 people.‡‡‡ This property results in a distribution with an exceptionally heavy tail, so that the vast majority of events will have very low casualty rates, with a couple of extreme outliers. Past studies have estimated this ratio for terrorism using biological and chemical weapons to be about 0.5 for 1 order of magnitude,47 meaning that an attack that kills 10x people is about 3 times less likely (100.5) than an attack that kills 10x–1 people (a concrete example is that attacks with more than 1,000 casualties, such as the Aum Shinrikyo attacks, will be about 30 times less probable than an attack that kills a single individual). Extrapolating the power law out, we find that the probability that an attack kills more than 5 billion will be (5 billion)–0.5 or 0.000014. Assuming 1 attack per year (extrapolated on the current rate of bio-attacks) and assuming that only 10% of such attacks that kill more than 5 billion eventually lead to extinction (due to the breakdown of society, or other knock-on effects), we get an annual existential risk of 0.0000014 (or 1.4 × 10–6). We can also use similar reasoning for warfare, where we have more reliable data (97 wars between 1820 and 1997, although the data are less specific to biological warfare). The parameter for warfare is 0.41,47 suggesting that wars that result in more than 5 billion casualties will comprise (5 billion)–0.41 = 0.0001 of all wars. Our estimate assumes that wars will occur with the same frequency as in 1820 to 1997, with 1 new war arising roughly every 2 years. It also assumes that in these extreme outlier scenarios, nuclear or contagious biological weapons would be the cause of such high casualty numbers, and that bioweapons specifically would be responsible for these enormous casualties about 10% of the time (historically bioweapons were deployed in WWI, WWII, and developed but not deployed in the Cold War—constituting a bioweapons threat in every great power war since 1900). Assuming that 10% of biowarfare escalations resulting in more than 5 billion deaths eventually lead to extinction, we get an annual existential risk from biowarfare of 0.0000005 (or 5 × 10–7). Perhaps the most interesting implication of the fatalities following a power law with a small exponent is that the majority of the expected casualties come from rare, catastrophic events. The data also bear this out for warfare and terrorism. The vast majority of US terrorism deaths occurred during 9/11, and the vast majority of terrorism injuries in Japan over the past decades came from a single Aum Shinrikyo attack. Warfare casualties are dominated by the great power wars. This suggests that a typical individual is far more likely to die from a rare, catastrophic attack as opposed to a smaller scale and more common one. If our goal is to reduce the greatest expected number of fatalities, we may be better off devoting resources to preventing the worst possible attacks. Why Uncertainty Is Not Cause for Reassurance Each of our estimates rely to some extent on guesswork and remain highly uncertain. Technological breakthroughs in areas such as diagnostics, vaccines, and therapeutics, as well as vastly improved surveillance, or even eventual space colonization, could reduce the chance of disease-related extinction by many orders of magnitude. Other breakthroughs such as highly distributed DNA synthesis or improved understanding of how to construct and modify diseases could increase or decrease the risks. Destabilizing political forces, the breakdown of the Biological Weapons Convention, or warfare between major world powers could vastly increase the amount of investment in bioweapons and create the incentives to actively use knowledge and biotechnology in destructive ways. Each of these factors suggests that our wide estimates could still be many orders of magnitude off from the true risk in this century. But uncertainty is not cause for reassurance. In instances where the probability of a catastrophe is thought to be extremely low (eg, human extinction from bioweapons), greater uncertainty around the estimates will typically imply greater risk of the catastrophe, as we have reduced confidence that the risk is actually at a low level.48 §§§ Given that our conservative models are based on historical data, they fail to account for the primary source of future risk: technological development that could radically democratize the ability to build advanced bioweapons. If the cost and required expertise of developing bioweapons falls far enough, the world might enter a phase where offensive capabilities dominate defensive ones. Some scholars, such as Martin Rees, think that humanity has about a 50% chance of going extinct due in large part to such technologies.49 However, incorporating these intuitions and technological conjectures would mean relying on qualitative arguments that would be far more contentious than our conservative estimates. We therefore proceed to assess the cost-effectiveness on the basis of our conservative models, until superior models of the risk emerge.

Sign in to recut, update, or save this card.