Towards Skilled Population Curriculum For Multi-agent Reinforcement Learning

Abstract

Recent advances in multi-agent reinforcement learning (MARL) allow agents to coordinate their behaviors in complex environments. However, common MARL algorithms still suffer from scalability and sparse reward issues. One promising approach to resolving them is automatic curriculum learning (ACL). ACL involves a student (curriculum learner) training on tasks of increasing difficulty controlled by a teacher (curriculum generator). Despite its success, ACL's applicability is limited by (1) the lack of a general student framework for dealing with the varying number of agents across tasks and the sparse reward problem, and (2) the non-stationarity of the teacher's task due to ever-changing student strategies. As a remedy for ACL, we introduce a novel automatic curriculum learning framework, Skilled Population Curriculum (SPC), which adapts curriculum learning to multi-agent coordination. Specifically, we endow the student with population-invariant communication and a hierarchical skill set,

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2023towards

Related papers

• Evolutionary Population Curriculum For Scaling Multi-agent Reinforcement Learning (2020)0.00
• Learning Progress Driven Multi-agent Curriculum (2022)0.00
• Curriculum Learning With Counterfactual Group Relative Policy Advantage For Multi-agent Reinforcement Learning (2025)0.00
• Variational Automatic Curriculum Learning For Sparse-reward Cooperative Multi-agent Problems (2021)0.00
• Accelerate Multi-agent Reinforcement Learning In Zero-sum Games With Subgame Curriculum Learning (2023)0.00
• Curriculum Learning For Cooperation In Multi-agent Reinforcement Learning (2023)0.00
• Stackelberg Games For Learning Emergent Behaviors During Competitive Autocurricula (2023)5.84
• Robustness To Multi-modal Environment Uncertainty In MARL Using Curriculum Learning (2023)0.00