Procurement changes forces the expenditure of human and political capital
Gilli, 2020 - Senior Researcher at the NATO Defense College [Andrea, NDC Research Paper No.15 – December ““NATO-Mation”: Strategies for Leading in the Age of Artificial Intelligence” https://www.ndc.nato.int/news/news.php?icode=1514 Acc 4/21/22 TA, reunderlined by JMP]
Defence procurement is particularly complex, given the range of strict requirements and specifications with which contractors have to comply.251 This is why traditional weapons manufacturers generally have an advantage when it comes to approaching defence buyers.252 AI, however, will entail a paradigm shift because the capabilities will continuously evolve. For AI-enabled autonomous systems in particular, as mentioned above, decision-making is “non-deterministic” and depends on the “dynamic environment” in which the system operates.253 This means that “traditional development and procurement approaches, based on full-path regression, are unfit”.254 This means that R&D also continues in the product deployment phase, as data and algorithms keep providing information and feedback that have to be integrated in order to achieve initial operational capabilities. Current “waterfall” procurement paradigms are set up so that engineers test prototypes according to defined specifications, and then subsequently move to production.255 With machine learning, the specifications will keep evolving as algorithms are fed new data.256 By extension, this means that testing cannot be treated as a singular phase prior to production and development. For NATO Allies, a more iterative procurement paradigm that does not depend on the sequential “waterfall” entails unique challenges. The integration of enterprise AI requires specific technical, legal, and organizational capabilities. This is linked to human-capital challenges in requirements, procurement and operations communities, as organizations leveraging AI “need their own people who know how to structure the problem, handle the data, and stay aware of evolving opportunities”.257 The development of AI-centred major weapon systems similarly calls for reform, or at least a remarkable adaptation, of defence procurement.258 Significant political, organizational and human capital will have to be invested. This is an additional reason why a centre such as the proposed A3IC could support the transition, through best practices, lessons learned and similar initiatives.