Tizero: Mastering Multi-agent Football With Curriculum Learning And Self-play
2023 · Fanqi Lin, Shiyu Huang, Tim Pearce, et al.
Abstract
Multi-agent football poses an unsolved challenge in AI research. Existing work has focused on tackling simplified scenarios of the game, or else leveraging expert demonstrations. In this paper, we develop a multi-agent system to play the full 11 vs. 11 game mode, without demonstrations. This game mode contains aspects that present major challenges to modern reinforcement learning algorithms; multi-agent coordination, long-term planning, and non-transitivity. To address these challenges, we present TiZero; a self-evolving, multi-agent system that learns from scratch. TiZero introduces several innovations, including adaptive curriculum learning, a novel self-play strategy, and an objective that optimizes the policies of multiple agents jointly. Experimentally, it outperforms previous systems by a large margin on the Google Research Football environment, increasing win rates by over 30%. To demonstrate the generality of TiZero's innovations, they are assessed on several environments beyon
Authors
(none)
Tags
Stats
Related papers
- Tikick: Towards Playing Multi-agent Football Full Games From Single-agent Demonstrations (2021)0.00
- Google Research Football: A Novel Reinforcement Learning Environment (2019)17.22
- Learning To Play Soccer From Scratch: Sample-efficient Emergent Coordination Through Curriculum-learning And Competition (2021)0.00
- Boosting Studies Of Multi-agent Reinforcement Learning On Google Research Football Environment: The Past, Present, And Future (2023)4.52
- Towards Better Sample Efficiency In Multi-agent Reinforcement Learning Via Exploration (2025)0.00
- An Empirical Study On Google Research Football Multi-agent Scenarios (2023)6.77
- Emergent Coordination Through Competition (2019)0.00
- Developing, Evaluating And Scaling Learning Agents In Multi-agent Environments (2022)2.26