Free beta access. 5 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

LAWS produce ethical and logistic quandaries – weaponizing AI accelerates causalities and human rights abuses

Amnesty International 15 (Amnesty International is a global movement of more than 3 million supporters, members and activists in more than 150 countries and territories who campaign to end grave abuses of human rights. Our vision is for every person to enjoy all the rights enshrined in the Universal Declaration of Human Rights and other international human rights standards. We are independent of any government, political ideology, economic interest or religion and are funded mainly by our membership and public donations.) “AUTONOMOUS WEAPONS SYSTEMS: FIVE KEY HUMAN RIGHTS ISSUES FOR CONSIDERATION” April 10 2015 https://www.amnesty.org/en/documents/act30/1401/2015/en/ // ZX

Over the past decade, there have been extensive advances in artificial intelligence and other technologies. These will make possible the development and deployment of fully autonomous weapons systems which, once activated, can select, attack, kill and wound human targets, and will be able to operate without effective human control. These weapons systems are often referred to as Lethal Autonomous Robotics (LARs), Lethal Autonomous Weapons Systems (LAWS) and, more comprehensively, Autonomous Weapons Systems (AWS). The rapid development of these weapons systems could not only change the entire nature of warfare, it could also dramatically alter the conduct of law enforcement operations and raises extremely serious human rights concerns, undermining the right to life, the prohibition of torture and other ill-treatment, and the right to security of person, and other human rights. Amnesty International has taken the view that AWS is a useful term for these weapons systems, since these systems can (i) be designed to have lethal or less lethal effects and (ii) be used in armed conflict and/or law enforcement situations. With proliferation they are likely to come to be used by non-state armed groups, criminal gangs and private companies and individuals. Amnesty International takes the term ‘autonomous’ to mean weapons capable of selecting targets and triggering an attack without effective or meaningful human control1 that can ensure the lawful use of force. Such systems would use violence (including less-lethal force) against individuals, and could have adverse consequences for a person’s human rights. While the development of AWS clearly raises serious and legitimate ethical and societal concerns, this briefing paper will examine the implications of AWS in the context of international law, particularly international human rights law and standards. The important concerns around their use in situations of armed conflict, and thus their ability to comply fully with international humanitarian law (IHL), has been the focus of previous work on AWS, including by Human Rights Watch, other members of the Campaign to Stop Killer Robots and the International Committee of the Red Cross (ICRC). This briefing paper, however, will address some of the implications for human rights related to AWS, particularly those rights and standards that govern the conduct of law enforcement operations. Amnesty International believes that the questions surrounding the development and potential use of AWS outside armed conflict (and the ability of such systems to comply with human rights law) are at least as daunting as those related to their use on the battlefield and urgently require attention and consideration2 , ultimately leading to concrete steps that will address this important area of international law. Amnesty International has identified five key human rights issues for consideration in the current debate on AWS: 1) The scope of the Convention on Certain Conventional Weapons (CCW) does not cover non-conflict situations; 2) AWS will not be able to comply with relevant international human rights law (IHRL) and policing standards; 3) Developments in existing semi-autonomous weapons technology pose fundamental challenges for the IHRL framework; 4) In the absence of a prohibition, AWS must be subject to independent weapons reviews; and 5) AWS will erode accountability mechanisms. The issues identified are by no means exhaustive, but rather seek to elucidate the principal concerns around the potential use of AWS in law enforcement operations. This briefing argues that the use of AWS, including less-lethal robotic weapons, in law enforcement operations would be fundamentally incompatible with international human rights law, and would lead to unlawful killings, injuries and other violations of human rights. Furthermore, the use of AWS would pose serious challenges in holding accountable those responsible for serious violations and could entrench impunity for crimes under international law. Consequently, Amnesty International supports the call for a pre-emptive ban on the development, transfer, deployment and use of AWS, including fully autonomous systems that deploy less-lethal weapons and can result in death or serious injury. In the absence of a prohibition, Amnesty International supports the call of UN Special Rapporteur on extrajudicial, summary or arbitrary executions, Christof Heyns, to impose a moratorium on the development, transfer, deployment and use of AWS and ensure that moratorium covers both lethal and less-lethal weapons. This principle deals with two different thresholds: a) when it is appropriate to use firearms (potentially lethal force) and b) the even higher threshold of when the intentional lethal use of firearms is permissible. Each of these situations involves a complex assessment of potential or imminent threats to life or serious injury and how to respond to them appropriately, and it involves deciding how best to protect the right to life, which is an absolutely fundamental duty of the state under human rights law. Such life and death decisions must never be delegated to AWS. In order to be able to carry out policing and law enforcement operations in a lawful manner, AWS would need to be able to effectively assess the degree to which there was an imminent threat of death or serious injury, identify correctly who is posing the threat, consider whether force is necessary to neutralize the threat, be able to identify and use means other than force, have the capacity to deploy different modes of communication and policing weapons and equipment to allow for a graduated response, and have available back up means and resources. To add to this complexity, each situation would require a different and unique response, which would be extremely challenging to reduce to a series of complex algorithms. It is not possible that AWS, without meaningful and effective human control and judgement, would be able to comply with these provisions, especially in unpredictable and ever-evolving environments. In an open letter in October 2013, computer scientists, engineers, artificial intelligence experts, roboticists and professionals from related disciplines from 37 countries asserted that “in the absence of clear scientific evidence that robot weapons have, or are likely to have in the foreseeable future, the functionality required for accurate target identification, situational awareness or decisions regarding the proportional use of force, we question whether they could meet the strict legal requirements for the use of force” and that “[G]iven the limitations and unknown future risks of autonomous robot weapons technology…,[D]ecisions about the application of violent force must not be delegated to machines.”15 The UNBPUFF places a due diligence requirement upon states to review weapons used in law enforcement. As Principle 3 of the UNBPUFF states, “the development and deployment of non-lethal incapacitating weapons should be carefully evaluated in order to minimize the risk of endangering uninvolved persons”. This review is limited to less-lethal weapons but is still important to ensure that those weapons will comply with relevant international standards and national laws and, moreover, given that evidence shows that “non-lethal” weapons can often have lethal effects which is why the term “less-lethal” is more appropriate. The requirement of a review of weapons used for law enforcement is even more important given the increasing ‘militarization’ of law enforcement operations, whereby military personnel assume roles often held by law enforcement agencies, such as policing of public assemblies. In the absence of a prohibition on AWS, states intending to develop, acquire, or use AWS must therefore be required to thoroughly review whether they can be used in a manner that fully respects relevant law and standards be it for law enforcement or military operations. This testing should be carried out by an independent body. The rapid technological advances that are moving towards full autonomy in weapons systems present serious concerns. The technology to allow fully autonomous operations may be reached soon; but it is extremely unlikely that programming that could ensure AWS perform law enforcement functions lawfully would be developed in the foreseeable future. Any new law enforcement equipment should be introduced based on clearly defined operational needs and technical requirements with a view to reduce the amount of force used and the risk and level of harm and injury caused. They must be subject to rigorous testing, by an independent expert body, and the testing, review and selection process should be legally constituted. In addition to assessing compliance with the UNBPUFF themselves, the process must test AWS compatibility with other key human rights treaties and standards, including ICCPR, International Covenant on Economic, Social and Cultural Rights (CESCR), the Convention Against Torture, the SMRTP and the UNCCLEO.

Sign in to recut, update, or save this card.