Free beta access. 5 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Current TEVV cannot establish Trust in AI – the tests were built for human pilots not autonomous drones

Costello, 2020 - Chief of Staff for Test Wing Atlantic [Donald, "Certifying an Autonomous System to Complete Tasks Currently Reserved for Qualified Pilots” - ProQuest https://www.proquest.com/docview/2495035965/fulltextPDF/D926A79B68D249D7PQ/1?accountid=14667 accessed on 6-21-2022 TM]

While some level of trust is required for certification officials to accept risk, there is not a clearly defined method for how we build trust in military systems. The current V&V techniques are designed for systems with a qualified pilot or operator. To achieve a level of trust, V&V techniques used for certifying autonomy must be sufficient that the certification officials will have trust in the actions of the decision engines controlling the vehicle, and trust that the system will not pose an unnecessary risk to mission completion. For a system to operate autonomously, it will need to sense the environment it is currently operating in. Upon sensing the environment, it will then need to properly classify the input its onboard sensors give it. Once it has interpreted the environment, and built its own SA, it will need to perform appropriate actions based on the unpredictable environments it will find itself in. This is a similar process that a fully qualified pilot is expected to perform once leadership has bestowed trust on their actions. One issue with using sensors to build the SA for a UAV 41 is the vast amount of data the needs to be filtered through. Using automation to process onboard imagery is not a new concept. From December 2013 to January 2015 a CubeSat was flown with multiple onboard sensors. An autonomous onboard processing was used to determine what images would be passed back to the ground station for further processing [64]. While trust is required for certification officials to accept risk, there is not a clearly defined method for how we build that trust in autonomous military systems. The V&V techniques used for certifying autonomy must be sufficient that the certification officials will have trust in the actions of the decision engines controlling military aircraft.

Sign in to recut, update, or save this card.