Learning To Coordinate With Anyone

Abstract

In open multi-agent environments, the agents may encounter unexpected teammates. Classical multi-agent learning approaches train agents that can only coordinate with seen teammates. Recent studies attempted to generate diverse teammates to enhance the generalizable coordination ability, but were restricted by pre-defined teammates. In this work, our aim is to train agents with strong coordination ability by generating teammates that fully cover the teammate policy space, so that agents can coordinate with any teammates. Since the teammate policy space is too huge to be enumerated, we find only dissimilar teammates that are incompatible with controllable agents, which highly reduces the number of teammates that need to be trained with. However, it is hard to determine the number of such incompatible teammates beforehand. We therefore introduce a continual multi-agent learning process, in which the agent learns to coordinate with different teammates until no more incompatible teammates c

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyyuan2023learning

Related papers

• Generating Teammates For Training Robust Ad Hoc Teamwork Agents Via Best-response Diversity (2022)0.00
• Curriculum Learning For Cooperation In Multi-agent Reinforcement Learning (2023)0.00
• Fast Teammate Adaptation In The Presence Of Sudden Policy Change (2023)0.00
• Learning Heterogeneous Agent Cooperation Via Multiagent League Training (2022)7.16
• Learning To Teach In Cooperative Multiagent Reinforcement Learning (2018)0.00
• Coordination-driven Learning In Multi-agent Problem Spaces (2018)0.00
• Learning Multiagent Coordination In The Absence Of Communication Channels (2018)0.00
• Multi-agent Cooperation Through Learning-aware Policy Gradients (2024)0.00