Hierarchical Macro Strategy Model For MOBA Game AI

Abstract

The next challenge of game AI lies in Real Time Strategy (RTS) games. RTS games provide partially observable gaming environments, where agents interact with one another in an action space much larger than that of GO. Mastering RTS games requires both strong macro strategies and delicate micro level execution. Recently, great progress has been made in micro level execution, while complete solutions for macro strategies are still lacking. In this paper, we propose a novel learning-based Hierarchical Macro Strategy model for mastering MOBA games, a sub-genre of RTS games. Trained by the Hierarchical Macro Strategy model, agents explicitly make macro strategy decisions and further guide their micro level execution. Moreover, each of the agents makes independent strategy decisions, while simultaneously communicating with the allies through leveraging a novel imitated cross-agent communication mechanism. We perform comprehensive evaluations on a popular 5v5 Multiplayer Online Battle Arena (M

Stats

• citations39
• S2 citations—
• github stars0
• HF likes0
• heat score12.02
• arxiv keywu2018hierarchical

Related papers

• Hierarchical Reinforcement Learning For Multi-agent MOBA Game (2019)0.00
• Towards Playing Full MOBA Games With Deep Reinforcement Learning (2020)0.00
• Mastering Complex Control In MOBA Games With Deep Reinforcement Learning (2019)0.00
• Macro Action Selection With Deep Reinforcement Learning In Starcraft (2018)9.92
• Starcraft Micromanagement With Reinforcement Learning And Curriculum Transfer Learning (2018)16.19
• Mimicking To Dominate: Imitation Learning Strategies For Success In Multiagent Competitive Games (2023)0.00
• High-level Strategy Selection Under Partial Observability In Starcraft: Brood War (2018)0.00
• Hierarchical Multi-agent Reinforcement Learning For Air Combat Maneuvering (2023)8.82