DOD standards for TEVV will leverage its influence with private companies and set a global norm for safety.
Flournoy, Haines et al 2020 - former Under Secretary of Defense for Policy and Director of National Intelligence [Michèle and Avril, Gabrielle Cheftiz Special Assistant to the Under Secretary of Defense for Policy October, “Building Trust through Testing Adapting DOD’s Test & Evaluation, Validation & Verification (TEVV) Enterprise for Machine Learning Systems, including Deep Learning Systems” https://cset. georgetown.edu/wp-content/uploads/Building-Trust-Through-Testing.pdf Acc 6/23/22 JZ]
4. Translate the testing framework into testable, verifiable requirements to be used by the private sector and build an integrated team to leverage this approach. DoD should establish a process for translating the testing framework into testable and verifiable requirements. DoD requirements would help standardize processes for industry contractors who develop AI for DoD and promote a faster and cheaper TEVV process by enabling the private sector to do some testing throughout development. The development of such requirements and standard processes would allow DoD to leverage the talent and expertise in the private sector, while maintaining DoD’s safety and risk standards and employing DoD’s operational knowledge and adversarial testing capabilities. Such requirements could additionally serve as the basis for standards that are promoted by the U.S. Government across the private sector and internationally, as discussed in a later recommendation. To realize this approach, DoD should build integrated, multi-disciplinary teams that reflect the entire development, testing, and sustainment life cycle. One model is the JAIC’s project manager model, which incorporates experts on product, policy, legal, test and evaluation, and requirements into one team. A similar approach is the Navy’s AI "DevRon” concept, a single entity accountable start to finish for the life cycle of capability development.29 Scaling this approach would help ensure requirements take into account the unique challenges of ML/DL TEVV. Requirements should also be written to advance the integration of ethics into the design and testing process. One case study for how this is already being done is DARPA’s Urban Reconnaissance through Supervised Autonomy (URSA) program, which is developing AI-infused drones that can help prevent friendly fire and civilian casualties in urban battles.30 This program brought in ethicists to anticipate challenges before development even began, with the aim of integrating ethics into the development loop. This URSA program offers useful lessons on how to conduct ethically aligned design of military systems that enables testing for robustness, safety, and security and ensures these systems are reliable and governable. Developing requirements and standards for ML/DL will help strengthen the link between DoD and industry, ensure a hybrid approach that leverages both private and public sector resources, and inject DoD’s safety and ethical requirements into industry development practices.