Multi-agent Curricula And Emergent Implicit Signaling

Abstract

Emergent communication has made strides towards learning communication from scratch, but has focused primarily on protocols that resemble human language. In nature, multi-agent cooperation gives rise to a wide range of communication that varies in structure and complexity. In this work, we recognize the full spectrum of communication that exists in nature and propose studying lower-level communication. Specifically, we study emergent implicit signaling in the context of decentralized multi-agent learning in difficult, sparse reward environments. However, learning to coordinate in such environments is challenging. We propose a curriculum-driven strategy that combines: (i) velocity-based environment shaping, tailored to the skill level of the multi-agent team; and (ii) a behavioral curriculum that helps agents learn successful single-agent behaviors as a precursor to learning multi-agent behaviors. Pursuit-evasion experiments show that our approach learns effective coordination, signific

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keygrupen2021multi

Related papers

• Low-bandwidth Communication Emerges Naturally In Multi-agent Learning Systems (2020)0.00
• On The Role Of Emergent Communication For Social Learning In Multi-agent Reinforcement Learning (2023)0.00
• Mimicry And The Emergence Of Cooperative Communication (2024)0.00
• Learning Practical Communication Strategies In Cooperative Multi-agent Reinforcement Learning (2022)0.00
• Learning Emergent Discrete Message Communication For Cooperative Reinforcement Learning (2021)5.24
• The Frost Hollow Experiments: Pavlovian Signalling As A Path To Coordination And Communication Between Agents (2022)0.00
• Emergent Coordination Through Competition (2019)0.00
• On The Pitfalls Of Measuring Emergent Communication (2019)2.26