On The Role Of Emergent Communication For Social Learning In Multi-agent Reinforcement Learning

Abstract

Explicit communication among humans is key to coordinating and learning. Social learning, which uses cues from experts, can greatly benefit from the usage of explicit communication to align heterogeneous policies, reduce sample complexity, and solve partially observable tasks. Emergent communication, a type of explicit communication, studies the creation of an artificial language to encode a high task-utility message directly from data. However, in most cases, emergent communication sends insufficiently compressed messages with little or null information, which also may not be understandable to a third-party listener. This paper proposes an unsupervised method based on the information bottleneck to capture both referential complexity and task-specific utility to adequately explore sparse social communication scenarios in multi-agent reinforcement learning (MARL). We show that our model is able to i) develop a natural-language-inspired lexicon of messages that is independently composed

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keykarten2023on

Related papers

• Learning Emergent Discrete Message Communication For Cooperative Reinforcement Learning (2021)5.24
• Multi-agent Curricula And Emergent Implicit Signaling (2021)0.00
• Emergent Social Learning Via Multi-agent Reinforcement Learning (2020)0.00
• Robust Multi-agent Reinforcement Learning With Social Empowerment For Coordination And Communication (2020)0.00
• Communicating Plans, Not Percepts: Scalable Multi-agent Coordination With Embodied World Models (2025)0.00
• Learning Practical Communication Strategies In Cooperative Multi-agent Reinforcement Learning (2022)0.00
• Over-communicate No More: Situated RL Agents Learn Concise Communication Protocols (2022)0.00
• Social Influence As Intrinsic Motivation For Multi-agent Deep Reinforcement Learning (2018)0.00