Heterogeneous Multi-agent Zero-shot Coordination By Coevolution

Abstract

Generating agents that can achieve zero-shot coordination (ZSC) with unseen partners is a new challenge in cooperative multi-agent reinforcement learning (MARL). Recently, some studies have made progress in ZSC by exposing the agents to diverse partners during the training process. They usually involve self-play when training the partners, implicitly assuming that the tasks are homogeneous. However, many real-world tasks are heterogeneous, and hence previous methods may be inefficient. In this paper, we study the heterogeneous ZSC problem for the first time and propose a general method based on coevolution, which coevolves two populations of agents and partners through three sub-processes: pairing, updating and selection. Experimental results on various heterogeneous tasks highlight the necessity of considering the heterogeneous setting and demonstrate that our proposed method is a promising solution for heterogeneous ZSC tasks.

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keyxue2022heterogeneous

Related papers

• Cross-environment Cooperation Enables Zero-shot Multi-agent Coordination (2025)0.00
• Towards Few-shot Coordination: Revisiting Ad-hoc Teamplay Challenge In The Game Of Hanabi (2023)0.00
• Tackling Cooperative Incompatibility For Zero-shot Human-ai Coordination (2023)0.00
• Zero Shot Coordination For Sparse Reward Tasks With Diverse Reward Shapings (2026)0.00
• Heterogeneous Multi-agent Reinforcement Learning For Zero-shot Scalable Collaboration (2024)6.34
• "other-play" For Zero-shot Coordination (2020)0.00
• Efficient Generation Of Diverse Cooperative Agents With World Models (2025)0.00
• Cooperative Open-ended Learning Framework For Zero-shot Coordination (2023)0.00