PECAN: Leveraging Policy Ensemble For Context-aware Zero-shot Human-ai Coordination

Abstract

Zero-shot human-AI coordination holds the promise of collaborating with humans without human data. Prevailing methods try to train the ego agent with a population of partners via self-play. However, these methods suffer from two problems: 1) The diversity of a population with finite partners is limited, thereby limiting the capacity of the trained ego agent to collaborate with a novel human; 2) Current methods only provide a common best response for every partner in the population, which may result in poor zero-shot coordination performance with a novel partner or humans. To address these issues, we first propose the policy ensemble method to increase the diversity of partners in the population, and then develop a context-aware method enabling the ego agent to analyze and identify the partner's potential policy primitives so that it can take different actions accordingly. In this way, the ego agent is able to learn more universal cooperative behaviors for collaborating with diverse par

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keylou2023pecan

Related papers

• Tackling Cooperative Incompatibility For Zero-shot Human-ai Coordination (2023)0.00
• Zero-shot Coordination In Ad Hoc Teams With Generalized Policy Improvement And Difference Rewards (2025)0.00
• Cross-environment Cooperation Enables Zero-shot Multi-agent Coordination (2025)0.00
• Maximum Entropy Population-based Training For Zero-shot Human-ai Coordination (2021)0.00
• Knowpc: Knowledge-driven Programmatic Reinforcement Learning For Zero-shot Coordination (2024)0.00
• "other-play" For Zero-shot Coordination (2020)0.00
• Cooperative Open-ended Learning Framework For Zero-shot Coordination (2023)0.00
• Heterogeneous Multi-agent Zero-shot Coordination By Coevolution (2022)5.24