Mimicry And The Emergence Of Cooperative Communication

Abstract

In many situations, communication between agents is a critical component of cooperative multi-agent systems, however, it can be difficult to learn or evolve. In this paper, we investigate a simple way in which the emergence of communication may be facilitated. Namely, we explore the effects of when agents can mimic preexisting, externally generated useful signals. The key idea here is that these signals incentivise listeners to develop positive responses, that can then also be invoked by speakers mimicking those signals. This investigation starts with formalising this problem, and demonstrating that this form of mimicry changes optimisation dynamics and may provide the opportunity to escape non-communicative local optima. We then explore the problem empirically with a simulation in which spatially situated agents must communicate to collect resources. Our results show that both evolutionary optimisation and reinforcement learning may benefit from this intervention.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keycope2024mimicry

Related papers

• Multi-agent Curricula And Emergent Implicit Signaling (2021)0.00
• Low-bandwidth Communication Emerges Naturally In Multi-agent Learning Systems (2020)0.00
• Learning Practical Communication Strategies In Cooperative Multi-agent Reinforcement Learning (2022)0.00
• Over-communicate No More: Situated RL Agents Learn Concise Communication Protocols (2022)0.00
• Mixed Cooperative-competitive Communication Using Multi-agent Reinforcement Learning (2021)5.84
• On The Pitfalls Of Measuring Emergent Communication (2019)2.26
• On The Role Of Emergent Communication For Social Learning In Multi-agent Reinforcement Learning (2023)0.00
• The Frost Hollow Experiments: Pavlovian Signalling As A Path To Coordination And Communication Between Agents (2022)0.00