DOD leadership is necessary to advance TEVV – it secures funding, provides visibility, and coordinates leadership. This signals the importance of reliability and safety.
Tarraf, Shelton, and Parker 2019 - Senior Information Scientist, Senior Engineer, and physical Scientist at the RAND Corporation [ Danielle C., William, Edward, et al RAND Cooperation, “The Department of Defense Posture for Artificial Intelligence”, file:///Users/MiraAgarwal/Downloads/RAND_RR4229%20(2).pdf, Acc 6/18/22, M.A.]
DoD should advance the science and practice of VVT&E of AI systems, working in close partnership with industry and academia. The JAIC, working closely with USD(R&E), USD(A&S), and operational test and evaluation, should take the lead in coordinating this effort both internally and with external partners. VVT&E is a critical consideration for DoD (see Chapter Three and Chapter Four), a significant challenge for the entire AI community (see Appendixes B and C), and a challenge that needs to be addressed, particularly as DoD looks to employ safety-critical AI systems. VVT&E has multiple facets that need to advance: from foundational research to establish the theory and science of V&V and the theoretical underpinnings of T&E, to the development of standards, guidelines, and engineering best practices for the VVT&E of systems being fielded and operated. Because of this, multiple entities within DoD and the government have stakes in VVT&E and roles to play. Indeed, DARPA and the service labs have significant roles to play in establishing the science and its foundations, while the JAIC has a role to play in setting guidelines and institutionalizing best practices in DoD. NIST also has a role to play in developing nationwide standards. Likewise, multiple entities outside government have a stake and a role, including academics researching the science and developing the foun- 74 The Department of Defense Posture for Artificial Intelligence dations and industry seeking to continue to leverage AI at scale.9 In an ideal world, the theory and the science of VVT&E would come first. In practice, AI systems are currently being deployed, and it is therefore important to develop and institute practical alternatives, including best practices and guidelines, while waiting for the theory and science to mature.10 Leadership and open cooperation among the many stakeholders, at various levels, are required to overcome the challenge of advancing the science and practice of VVT&E. It behooves DoD to focus significant efforts and resources in this direction; to take a leadership role nationally in view of its reliance on safety-critical systems; to seek engagements and partnerships with all stakeholders in industry and academia to advance the science and practice of VVT&E; and to keep Congress informed of the status of DoD’s activities, engagements, and partnerships in this regard. The JAIC should take the lead in spearheading coordination and keeping Congress informed of this national effort, both internally and with external partners. Recommendation T-5: All funded AI efforts should include a budget for AI VVT&E. This recommendation, in support of Recommendation S-2, is a forcing function that is relatively simple to implement and that can help ensure that the consideration of VVT&E is baked into the R&D of AI techniques and the design of AI solutions rather than considered as an afterthought further down the line. Although VVT&E during early R&D phases should be commonplace, we make this recommendation to explicitly reinforce its critical importance, to highlight the present lack of foundations for VVT&E in AI, and the importance of developing that science. 9 Indeed, as we note in Chapter Three and Appendix C, the Partnership on AI—a technology-industry consortium focused on establishing best practices for AI—appears to be moving toward establishing engineering guidelines for certification of ML. 10 Some of our industry interviewees indicated taking steps, internally and in industry partnerships, toward developing best practices (see Appendix C).