Multi-agent Continual Coordination Via Progressive Task Contextualization
2023 · Lei Yuan, Lihe Li, Ziqian Zhang, et al.
Abstract
Cooperative Multi-agent Reinforcement Learning (MARL) has attracted significant attention and played the potential for many real-world applications. Previous arts mainly focus on facilitating the coordination ability from different aspects (e.g., non-stationarity, credit assignment) in single-task or multi-task scenarios, ignoring the stream of tasks that appear in a continual manner. This ignorance makes the continual coordination an unexplored territory, neither in problem formulation nor efficient algorithms designed. Towards tackling the mentioned issue, this paper proposes an approach Multi-Agent Continual Coordination via Progressive Task Contextualization, dubbed MACPro. The key point lies in obtaining a factorized policy, using shared feature extraction layers but separated independent task heads, each specializing in a specific class of tasks. The task heads can be progressively expanded based on the learned task contextualization. Moreover, to cater to the popular CTDE paradi
Authors
(none)
Tags
Stats
Related papers
- Contextual Knowledge Sharing In Multi-agent Reinforcement Learning With Decentralized Communication And Coordination (2025)0.00
- Individual Specialization In Multi-task Environments With Multiagent Reinforcement Learners (2019)0.00
- An Initial Introduction To Cooperative Multi-agent Reinforcement Learning (2024)0.00
- Attention-guided Contrastive Role Representations For Multi-agent Reinforcement Learning (2023)3.64
- Policy Distillation And Value Matching In Multiagent Reinforcement Learning (2019)10.48
- A Structured Prediction Approach For Generalization In Cooperative Multi-agent Reinforcement Learning (2019)0.00
- LDSA: Learning Dynamic Subtask Assignment In Cooperative Multi-agent Reinforcement Learning (2022)3.58
- Learning To Coordinate In Multi-agent Systems: A Coordinated Actor-critic Algorithm And Finite-time Guarantees (2021)0.00