One next step would be to add more capabilities to the agents, such as better navigation or the ability to pick up and use
ammo in addition to health and armor.
The long-term goal would be to either add some high-level game algorithms in Cube, such as team AI or path-finding, or else implement a similar evolutionary algorithm in a more complex FPS.