Free beta access. 5 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Human control is ambiguous because the human in control is constantly changing their role.

Goldfarb and Lindsay, 2022 – Chair in AI and health care at the Univ of Toronto, Prof of Cybersecurity at the Georgia Tech [Avi, Jon, 2/25/22, https://doi.org/10.1162/isec_a_00425, “Prediction and Judgement: Why Artificial Intelligence Increases the Importance of Humans in War” 6/18/22, LND]

Human-machine teaming often entails not only task performance (i.e., balancing the cognitive load across people and AI) but also task design (i.e., adjusting the load as circumstances change). Viewed at a more granular level, a task that falls into the human-machine teaming category in our framework might be disaggregated into subtasks that fall into two of the framework's other categories. That is, human practitioners will have to partition a complex decision task into either fully automated or fully human decision-making subtasks. This subdivision requires making mindful decisions about monitoring and controlling the risks of premature automation. For example, human-machine teaming in drone operations involves having both the drone and the drone operators perform certain tasks autonomously. The drone might automatically perform flying tasks (i.e., maintaining course and bearing or reacquiring a lost datalink), while human drone operators might deliberate over legal targeting criteria. The overall partition (i.e., the location of the human in the loop) should be adjusted over time as conditions change, which will require humans to be mindful of how the division of labor between humans and machines relates to the task environment and the organizational mission. This balance will be further complicated by interdependencies across tasks and organizations, data access, interpretability, and interoperability issues, as well as competing priorities such as speed, safety, secrecy, efficiency, effectiveness, legality, cybersecurity, stability, adaptability, and so on. Importantly, as  shows, the organizational and political institutions that are exogenous to decision-making tasks establish the priorities for these different objectives. Humans are the ultimate source of judgment in all AI systems.

Sign in to recut, update, or save this card.