Oversight of AI fails
Stone 21 [Corin R. Stone, Scholar-in-Residence at the Washington College of Law; “Artificial Intelligence in the Intelligence Community: Oversight Must Not Be an Oversight”; November 30, 2021; DOA: 6/25/22; https://www.justsecurity.org/79254/artificial-intelligence-in-the-intelligence-community-oversight-must-not-be-an-oversight/; Lowell-ES]
But intelligence oversight is complicated and has not sufficiently evolved with the times. When it comes to assessing progress of IC programs, standard oversight processes typically track defined, pre-determined requirements, cost, and timelines. These metrics have worked reasonably well for large programs like the acquisition of satellites and buildings, for which there is a clear beginning, middle, and end, with easily identifiable milestones and a definite budget. However, AI is different; its development moves back and forth across a spectrum of activities often without discrete steps, and failure is a necessary part of the process as the technology evolves and matures. Traditional metrics are, therefore, less effective for AI, as the value (or lack thereof) of certain milestones may only become clear partway through the development process and desired end-states may shift.