Hierarchical Reinforcement Learning For Multi-agent MOBA Game

Abstract

Real Time Strategy (RTS) games require macro strategies as well as micro strategies to obtain satisfactory performance since it has large state space, action space, and hidden information. This paper presents a novel hierarchical reinforcement learning model for mastering Multiplayer Online Battle Arena (MOBA) games, a sub-genre of RTS games. The novelty of this work are: (1) proposing a hierarchical framework, where agents execute macro strategies by imitation learning and carry out micromanipulations through reinforcement learning, (2) developing a simple self-learning method to get better sample efficiency for training, and (3) designing a dense reward function for multi-agent cooperation in the absence of game engine or Application Programming Interface (API). Finally, various experiments have been performed to validate the superior performance of the proposed method over other state-of-the-art reinforcement learning algorithms. Agent successfully learns to combat and defeat bronze

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhang2019hierarchical

Related papers

• Hierarchical Macro Strategy Model For MOBA Game AI (2018)12.02
• Mastering Complex Control In MOBA Games With Deep Reinforcement Learning (2019)0.00
• Towards Playing Full MOBA Games With Deep Reinforcement Learning (2020)0.00
• Hierarchical Multi-agent Reinforcement Learning For Air Combat Maneuvering (2023)8.82
• Starcraft Micromanagement With Reinforcement Learning And Curriculum Transfer Learning (2018)16.19
• Mimicking To Dominate: Imitation Learning Strategies For Success In Multiagent Competitive Games (2023)0.00
• Centralized Control For Multi-agent RL In A Complex Real-time-strategy Game (2023)0.00
• Guiding Multi-agent Multi-task Reinforcement Learning By A Hierarchical Framework With Logical Reward Shaping (2024)0.00