Improved Verification and Validation would solve operators’ safety concerns about AI, building Trust.
Tarraf, Shelton, Parker 2019 - Senior Information Scientist, Senior Engineer, and physical Scientist at the RAND Corporation [ Danielle C., William, Edward, et al RAND Cooperation, “The Department of Defense Posture for Artificial Intelligence”, file:///Users/MiraAgarwal/Downloads/RAND_RR4229%20(2).pdf, Acc 6/18/22, M.A.]
As we noted in Chapter Three, our interviewees agreed that V&V of AI systems is a critical topic that DoD will need to address, particularly when it seeks to deploy and use safety-critical AI systems. 18 Interviewees both inside and outside DoD emphasized the importance of improving the understanding of human-machine interaction. 52 The Department of Defense Posture for Artificial Intelligence However, like our academic and industry interviewees (see section “Industry: Advancement and Adoption” in Appendix C), the interviewees lacked current V&V solutions and could not predict which technical avenues toward V&V would eventually prove to be effective for AI systems. Concerns about the “valley of death” and the failures in transitioning research to prototypes and products, both broadly and specifically for AI, also came up in our interviews.19 Finally, although our interviewees generally agreed that AI will have a bigger role to play, they also emphasized the need for training and experimentation to build trust and enhance adoption of these technologies, while noting that generational factors might help down the line.20