Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

4 – traceability AND comprehensibility – collection does NOT include context – makes leveraging it impossible – NO implementation of algorithms

Danielle C. Tarraf 19, William Shelton, Edward Parker, Brien Alkire, Diana Gehlhaus, Justin Grana, Alexis Levedahl, Jasmin Léveillé, Jared Mondschein, James Ryseff, Ali Wyne, Daniel Elinoff, Edward Geist, Benjamin N. Harris, Eric Hui, Cedric Kenney, Sydne Newberry, Chandler Sachs, Peter Schirmer, Danielle Schlang, Victoria M. Smith, Abbie Tingstad, Padmaja Vedula, and Kristin Warren, The Department of Defense Posture for Artificial Intelligence: Assessment and Recommendations, RAND Corporation, 2019. https://www.rand.org/pubs/research_reports/RR4229.html, nihara

The data that exist are not always understandable or traceable. DoD systems frequently lack the documentation or metadata required to provide context as to what particular data actually mean or how they were generated. For example, an Army database might store a numeric value for the number of tanks at a particular facility, but it might not explain whether this number indicates all functional tanks, all tanks assigned to a particular unit, or all tanks of any status present at the location. Other data values with less descriptive names will frequently be even more difficult to comprehend and use. The lack of any centralized tool for data service means that it is difficult for DoD personnel, even in leadership, to discover what data might be available to inform a question. Instead, discovering new data sources and interpreting them typically requires personal networks or other informal mechanisms.

In sum, all indications are that DoD data are not currently being used to their full potential. Overall, the problems we noted here represent a formidable obstacle to implementing AI algorithms,35 even at the level of enterprise AI. Both Project Maven and the JAIC’s preventative maintenance prototype have found that issues around data quality and availability are a primary barrier to progress (see section “Data” in Appendix B). These issues, if left unresolved, will continue to hamper the development and deployment of AI throughout DoD. Additionally, we highlight the following friction point.

Sign in to recut, update, or save this card.