Smart Bandits: Intelligent opponents in mission simulation

R&D case

R&D case: Smart Bandits decision making module

Intelligent opponents in mission simulation

The challenge

In military simulations, computer-generated forces (CGFs) are autonomous entities that represent friendly, neutral or hostile air, ground surface, or subsurface-based units, platforms or individuals. The behaviour that CGFs display in the simulations is modelled to resemble realistic human behaviour. CGFs are typically used in application areas such as training, mission rehearsal, concept development and experimentation (CD&E) or decision support. For each application, the CGFs require different behaviour models. However, traditional modelling techniques do not give scope for expression and keep modellers from quickly developing new models. New approaches to behaviour modelling are therefore required.

The solution

The results of the studies have been combined in a user-friendly graphical behaviour modelling tool. The tool was named Smart Bandits (after the project). It lets modellers quickly implement behaviour models and link the new models to the CGFs in a simulation engine. While the CGFs make their observations in the simulated world, the Smart Bandits tool calculates their next actions. During simulations, the behaviour models can easily be inspected to see what the CGFs are thinking. Apart from being an intuitive modelling tool, Smart Bandits continues to be a platform for behaviour modelling research. NLR is continuously experimenting with new modelling techniques and new ways of interacting with CGFs.

Smart Bandits - Intelligent opponents in mission simulation

What did we do?

To this end, we carried out research in two main directions, namely human behaviour and computational modelling. In the former, we specifically studied situational awareness (i.e. perception of the environment) and theory of mind (i.e. beliefs, desires and intentions). In computational modelling, we studied the use of machine learning techniques for enhancing classical modelling techniques such as finite-state machines and behaviour trees.

A key component of the Smart Bandits project was the evaluation of newly developed techniques in human-in-the-loop simulations, such as in NLR’s Fighter 4-Ship networked F-16 simulator.

NLR Marknesse

Information

Latest cases

Construction and Manufacturing

29 April 2025

R&D case FLAPsense

Optical sensor system for real- time proprotor FLAPping angle monitoring – FLAPsense The real-time monitoring of the flapping of the rotor hub of a Next Generation Civil Tilt Rotor (NextGenCTR) aircraft enables the enhancement of the proprotor performance and operational safety. Accurate deformation and motion measurements in the rotating frame are a highly challenging task. […]
Construction and Manufacturing

20 March 2025

R&D case: Enabling temperature control for large scale additive manufacturing

The challenge One of the main challenges of Large Scale 3D printing of high temperature thermoplastics is the control of the interface temperature – which determines the degree of bonding between consecutive layers. When the deposited material has cooled down in excess, poor adhesion is achieved between layers, leading to insufficient strength, delamination, cracking and […]
Sustainability and Environment

28 January 2025

R&D case COCOLIH2T - Composite Conformal Liquid H2 Tank

The global aviation industry is committed to reducing global net aviation carbon emissions by 50% by the year 2050, with the European Commission pursuing a more ambitious goal of a 75% reduction in CO2 emissions per passenger kilometre. Alternative fuels such as liquid hydrogen (LH2) are seen as playing a central role in a zero-emission […]