A Competition Winning Deep Reinforcement Learning Agent In Microrts

Abstract

Scripted agents have predominantly won the five previous iterations of the IEEE microRTS (\(\mu\)RTS) competitions hosted at CIG and CoG. Despite Deep Reinforcement Learning (DRL) algorithms making significant strides in real-time strategy (RTS) games, their adoption in this primarily academic competition has been limited due to the considerable training resources required and the complexity inherent in creating and debugging such agents. RAISocketAI is the first DRL agent to win the IEEE microRTS competition. In a benchmark without performance constraints, RAISocketAI regularly defeated the two prior competition winners. This first competition-winning DRL submission can be a benchmark for future microRTS competitions and a starting point for future DRL research. Iteratively fine-tuning the base policy and transfer learning to specific maps were critical to RAISocketAI's winning performance. These strategies can be used to economically train future DRL agents. Further work in Imitation

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keygoodfriend2024a

Related papers

• Deep RTS: A Game Environment For Deep Reinforcement Learning In Real-time Strategy Games (2018)16.97
• A Human Mixed Strategy Approach To Deep Reinforcement Learning (2018)7.50
• Macro Action Selection With Deep Reinforcement Learning In Starcraft (2018)9.92
• Centralized Control For Multi-agent RL In A Complex Real-time-strategy Game (2023)0.00
• Control-optimized Deep Reinforcement Learning For Artificially Intelligent Autonomous Systems (2025)0.00
• Multi-agent Deep Reinforcement Learning Using Attentive Graph Neural Architectures For Real-time Strategy Games (2021)7.16
• Population-based Evaluation In Repeated Rock-paper-scissors As A Benchmark For Multiagent Reinforcement Learning (2023)0.00
• SEED RL: Scalable And Efficient Deep-rl With Accelerated Central Inference (2019)0.00