Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

AI increases the risk of miscalculation.

Mark Fitzpatrick, 2019 (former deputy assistant secretary of state for non-proliferation, “Artificial Intelligence and Nuclear Command and Control,” Survival, June-July 2019)

The QuantumAI aspect of the exercise was one manifestation of what the background paper described as a ‘black box model extraction’ vulner-ability. Such an extraction reverse-engineers an AI system to determine its parameters. An adversary may be able to use this information to enhance the effectiveness of future operations against the system by stealing intel-lectual property; identifying sensitive or proprietary information related to the system’s training data or objectives; or developing ‘adversarial inputs’ to be covertly introduced into the original AI system. Such inputs confuse the system’s classifiers or its pattern-recognition function, thereby causing it to miscalculate, misclassify or misinterpret elements in its oper¬ational environment.

Sign in to recut, update, or save this card.