Emergent Quantized Communication

Abstract

The field of emergent communication aims to understand the characteristics of communication as it emerges from artificial agents solving tasks that require information exchange. Communication with discrete messages is considered a desired characteristic, for both scientific and applied reasons. However, training a multi-agent system with discrete communication is not straightforward, requiring either reinforcement learning algorithms or relaxing the discreteness requirement via a continuous approximation such as the Gumbel-softmax. Both these solutions result in poor performance compared to fully continuous communication. In this work, we propose an alternative approach to achieve discrete communication -- quantization of communicated messages. Using message quantization allows us to train the model end-to-end, achieving superior performance in multiple setups. Moreover, quantization is a natural framework that runs the gamut from continuous to discrete communication. Thus, it sets the

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keycarmeli2022emergent

Related papers

• An Analysis Of Discretization Methods For Communication Learning With Multi-agent Reinforcement Learning (2022)0.00
• Rgmcomm: Return Gap Minimization Via Discrete Communications In Multi-agent Reinforcement Learning (2023)6.77
• Inductive Bias For Emergent Communication In A Continuous Setting (2023)0.00
• Learning Emergent Discrete Message Communication For Cooperative Reinforcement Learning (2021)5.24
• Multi-agent Curricula And Emergent Implicit Signaling (2021)0.00
• An In-depth Analysis Of Discretization Methods For Communication Learning Using Backpropagation With Multi-agent Reinforcement Learning (2023)0.00
• Learning What To Say And How Precisely: Efficient Communication Via Differentiable Discrete Communication Learning (2025)0.00
• On The Pitfalls Of Measuring Emergent Communication (2019)2.26