SCC: An Efficient Deep Reinforcement Learning Agent Mastering The Game Of Starcraft II

Abstract

AlphaStar, the AI that reaches GrandMaster level in StarCraft II, is a remarkable milestone demonstrating what deep reinforcement learning can achieve in complex Real-Time Strategy (RTS) games. However, the complexities of the game, algorithms and systems, and especially the tremendous amount of computation needed are big obstacles for the community to conduct further research in this direction. We propose a deep reinforcement learning agent, StarCraft Commander (SCC). With order of magnitude less computation, it demonstrates top human performance defeating GrandMaster players in test matches and top professional players in a live event. Moreover, it shows strong robustness to various human strategies and discovers novel strategies unseen from human plays. In this paper, we will share the key insights and optimizations on efficient imitation learning and reinforcement learning for StarCraft II full game.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2020scc

Related papers

• Tstarbot-x: An Open-sourced And Comprehensive Study For Efficient League Training In Starcraft II Full Game (2020)0.00
• Tstarbots: Defeating The Cheating Level Builtin AI In Starcraft II In The Full Game (2018)0.00
• Applying Supervised And Reinforcement Learning Methods To Create Neural-network-based Agents For Playing Starcraft II (2021)0.00
• Alphastar: An Evolutionary Computation Perspective (2019)15.13
• Starcraft II: A New Challenge For Reinforcement Learning (2017)0.00
• An Introduction Of Mini-alphastar (2021)0.00
• Macro Action Selection With Deep Reinforcement Learning In Starcraft (2018)9.92
• Starcraft Micromanagement With Reinforcement Learning And Curriculum Transfer Learning (2018)16.19