Modeling Sensorimotor Coordination As Multi-agent Reinforcement Learning With Differentiable Communication

Abstract

Multi-agent reinforcement learning has shown promise on a variety of cooperative tasks as a consequence of recent developments in differentiable inter-agent communication. However, most architectures are limited to pools of homogeneous agents, limiting their applicability. Here we propose a modular framework for learning complex tasks in which a traditional monolithic agent is framed as a collection of cooperating heterogeneous agents. We apply this approach to model sensorimotor coordination in the neocortex as a multi-agent reinforcement learning problem. Our results demonstrate proof-of-concept of the proposed architecture and open new avenues for learning complex tasks and for understanding functional localization in the brain and future intelligent systems.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyjing2019modeling

Related papers

• Improving Coordination In Small-scale Multi-agent Deep Reinforcement Learning Through Memory-driven Communication (2019)12.25
• Mixed Cooperative-competitive Communication Using Multi-agent Reinforcement Learning (2021)5.84
• Optimization For Reinforcement Learning: From Single Agent To Cooperative Agents (2019)14.62
• Communicating Plans, Not Percepts: Scalable Multi-agent Coordination With Embodied World Models (2025)0.00
• Counterfactual Multi-agent Reinforcement Learning With Graph Convolution Communication (2020)0.00
• Coordination-driven Learning In Multi-agent Problem Spaces (2018)0.00
• Learning To Schedule Communication In Multi-agent Reinforcement Learning (2019)0.00
• Hierarchical Reinforcement Learning With Opponent Modeling For Distributed Multi-agent Cooperation (2022)5.84