Macro Action Selection With Deep Reinforcement Learning In Starcraft

Abstract

StarCraft (SC) is one of the most popular and successful Real Time Strategy (RTS) games. In recent years, SC is also widely accepted as a challenging testbed for AI research because of its enormous state space, partially observed information, multi-agent collaboration, and so on. With the help of annual AIIDE and CIG competitions, a growing number of SC bots are proposed and continuously improved. However, a large gap remains between the top-level bot and the professional human player. One vital reason is that current SC bots mainly rely on predefined rules to select macro actions during their games. These rules are not scalable and efficient enough to cope with the enormous yet partially observed state space in the game. In this paper, we propose a deep reinforcement learning (DRL) framework to improve the selection of macro actions. Our framework is based on the combination of the Ape-X DQN and the Long-Short-Term-Memory (LSTM). We use this framework to build our bot, named as LastOr

Stats

• citations20
• S2 citations—
• github stars0
• HF likes0
• heat score9.92
• arxiv keyxu2018macro

Related papers

• Starcraft Micromanagement With Reinforcement Learning And Curriculum Transfer Learning (2018)16.19
• SCC: An Efficient Deep Reinforcement Learning Agent Mastering The Game Of Starcraft II (2020)0.00
• Episodic Exploration For Deep Deterministic Policies: An Application To Starcraft Micromanagement Tasks (2016)0.00
• Applying Supervised And Reinforcement Learning Methods To Create Neural-network-based Agents For Playing Starcraft II (2021)0.00
• Tstarbots: Defeating The Cheating Level Builtin AI In Starcraft II In The Full Game (2018)0.00
• Tstarbot-x: An Open-sourced And Comprehensive Study For Efficient League Training In Starcraft II Full Game (2020)0.00
• High-level Strategy Selection Under Partial Observability In Starcraft: Brood War (2018)0.00
• Starcraft II: A New Challenge For Reinforcement Learning (2017)0.00