Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Cyber Defense Exercises (CDX) are an effective tool to evaluate the effectiveness of defense systems and protect infrastructure

Seker & Seker 20 (Seker, Ensar, and Kamile Nur Seker, Nato Researcher and Cyber Security Expert. "Cyber Defense Exercises (CDXs) as a Testbed for Cyber Security Assessments. June 2020)

CDXs are suitable platforms to test the IT and OT systems to be able to create better cyber security and cyber defense solutions. In this chapter, we will take a closer look to Locked Shields CDX to analyze how cyber exercises can be used as testbed environments. Lesson learned sections and evaluation of the exercise by all participants, can give ideas to cyber experts to improve and strengthen their security. So, it’s fair to say that CDXs can serve as excellent testbeds. Cyber experts from different fields who participate CDX can share their knowledge and experience each other via these exercises. Figure 3 shows a model for CDXs as a testbed.Locked Shields (LS) cyber defense exercise is organized annually by the NATO Cooperative Cyber Defense Centre of Excellence (NATO CCD COE). It’s accepted by the authorities that Locked Shields is the world's largest, most complex and technologically advanced cyber defense exercise. In Locked Shields, blue teams are created by the NATO member nations or NATO allied nations. So, it is an international cyber exercise in state level. Locked Shields could be a good example to show how CDX can be used as testbed. Figure 4, 5, 6 shows some statistics about LS CDX. Based on Figure 4, while there were 9 blue teams in 2012 LS CDX, the number was increased to 22 in 2018. In Figure 6, the number of participants to LS CDX also growth (250, 250, 300, 400, 550, 800, 1000 respectively) in same period. This means LS CDX was able to attract more nations and more cyber experts every year. According to Figure 5, numbers of virtual machines were increased dramatically from 25 to 4000 in 6 years. It means LS CDX is getting more advance and complicated each year. More than 1000 cybersecurity experts from around the world have been involved in the 2018 Locked Shields exercise and the national teams of 21 countries have participated as blue teams. The exercise involved around 4000 virtualized systems and more than 2500 attacks by the red team. LS CDX follows a successful route to adopting information technology (IT) and operational technology (OT) systems. The organizers of LS CDX succeeded in providing an interesting and complex environment for the blue teams to defend these against an intensive attack campaign. While blue teams can put their skills to test, they can also analyze and test new technologies in a safe and secure environment. In the context of LS13, the following areas were most challenging for the blue teams: Defending web applications. Detecting custom malicious code. Mitigating BGP hijacking attacks. Initiating efficient information sharing. In LS14, the most challenging areas are for blue teams: Filtering and detecting malicious traffic over IPv6. Monitoring for malicious WAN route changes and preventing BGP hijacking/man-in-the-middle. Protecting custom web applications. Finding pre-planted malicious programs and coping with RT‟s Anti-Virus evasion techniques (publicly available free tools were in most cases enough to evade AV solutions). Sharing actionable information with other blue teams. In 2015, new attack vectors included ICS/SCADA systems and Windows 8 and 10 operating systems, as well as an element of active defense. In 2017 the blue teams were tasked to maintain the services and networks of a military air base of a fictional country, which, according to the exercise scenario, experienced severe attacks on its electric power grid system, unmanned aerial vehicles, military command and control systems, critical information infrastructure components and other operational infrastructure. The size and scope of technologies, networks and devices used in Locked Shields 2017 has increased considerably – leading to more attacks and specialized systems involved. Specialized systems enable teams to practice the defense of systems that they are not working with on a regular basis. However, in the modern threat landscape incidents with specialized systems may potentially have a profound effect on a military mission or the entire society. In 2018, the attacks cause severe disruptions in the operation of the electric power grid, 4G public safety networks, drone operation and other critical infrastructure components. While the aim of the tech game is to maintain the operation of various systems under intense pressure, the strategic part should serve as a forum to understand the impact of decisions made at the strategic and policy level. When we analyze LS CDX, based on the statistics and After Action Reports (ARR), it can be said that, the exercise improved itself during the years and created a suitable testbed platform for cyber experts. Via this platform, professionals and decision makers in cyber were able to share their knowledge and experience with each other and test their defense skills and strategies against new technologies and new attacks. For future studies, a technical tool will be developed on the scoring system, which is a problematic issue for CDXs, and on the standardization of this system and the development of a fairer system. The integration of new technologies such as power grid systems and drone control systems into CDXs is a critical issue. With the integration of these special systems into the exercises, the existing problems and the methods to be followed are another work to be done in the future. The importance of defense exercises is increasing day by day. It would be possible for countries to be involved in the global cyber defense exercises in the international arena, spreading the development and implementation of their own CDX platforms on a national basis, and allocating higher budget figures to the planning and development of these exercises could contribute to achieving beneficial outcomes in the future to create stronger cyber defense systems. The emphasis on these exercises on the national and 18 international scene will provide benefits in terms of uncovering the vulnerabilities in the area of the cyberspace, as well as the revitalization of the cyber defense awareness, and also the integrated technologies that can be followed in exercises related to the cyber defense.

Sign in to recut, update, or save this card.