Improving Coordination In Small-scale Multi-agent Deep Reinforcement Learning Through Memory-driven Communication
2019 · Emanuele Pesce, Giovanni Montana
Abstract
Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced with tasks requiring coordination and synchronisation skills, inter-agent communication plays an essential role. In this work, we propose a framework for multi-agent training using deep deterministic policy gradients that enables concurrent, end-to-end learning of an explicit communication protocol through a memory device. During training, the agents learn to perform read and write operations enabling them to infer a shared representation of the world. We empirically demonstrate that concurrent learning of the communication device and individual policies can improve inter-agent coordination and performance in small-scale systems. Our experimental results show that the proposed method achieves superior performance in scenarios with up to six agents. We
Authors
(none)
Tags
Stats
Related papers
- Modeling Sensorimotor Coordination As Multi-agent Reinforcement Learning With Differentiable Communication (2019)0.00
- Improved Reinforcement Learning In Cooperative Multi-agent Environments Using Knowledge Transfer (2021)0.00
- Research On Multi-agent Communication And Collaborative Decision-making Based On Deep Reinforcement Learning (2023)0.00
- Learning To Schedule Communication In Multi-agent Reinforcement Learning (2019)0.00
- Learning Practical Communication Strategies In Cooperative Multi-agent Reinforcement Learning (2022)0.00
- Scalable Centralized Deep Multi-agent Reinforcement Learning Via Policy Gradients (2018)0.00
- Minimizing Communication While Maximizing Performance In Multi-agent Reinforcement Learning (2021)0.00
- Mixed Cooperative-competitive Communication Using Multi-agent Reinforcement Learning (2021)5.84