Hierarchical Multi-agent Reinforcement Learning For Air Combat Maneuvering

Abstract

The application of artificial intelligence to simulate air-to-air combat scenarios is attracting increasing attention. To date the high-dimensional state and action spaces, the high complexity of situation information (such as imperfect and filtered information, stochasticity, incomplete knowledge about mission targets) and the nonlinear flight dynamics pose significant challenges for accurate air combat decision-making. These challenges are exacerbated when multiple heterogeneous agents are involved. We propose a hierarchical multi-agent reinforcement learning framework for air-to-air combat with multiple heterogeneous agents. In our framework, the decision-making process is divided into two stages of abstraction, where heterogeneous low-level policies control the action of individual units, and a high-level commander policy issues macro commands given the overall mission targets. Low-level policies are trained for accurate unit combat control. Their training is organized in a learnin

Stats

• citations14
• S2 citations—
• github stars0
• HF likes0
• heat score8.82
• arxiv keyselmonaj2023hierarchical

Related papers

• Multi-agent Deep Reinforcement Learning With Human Strategies (2018)8.09
• Hierarchical Reinforcement Learning For Multi-agent MOBA Game (2019)0.00
• The AI Arena: A Framework For Distributed Multi-agent Reinforcement Learning (2021)0.00
• Hierarchical Reinforcement Learning With Opponent Modeling For Distributed Multi-agent Cooperation (2022)5.84
• Scaling Intelligent Agents In Combat Simulations For Wargaming (2024)0.00
• Strategic Coordination For Evolving Multi-agent Systems: A Hierarchical Reinforcement And Collective Learning Approach (2025)0.00
• Deep Multiagent Reinforcement Learning: Challenges And Directions (2021)0.00
• A Further Exploration Of Deep Multi-agent Reinforcement Learning With Hybrid Action Space (2022)5.84