Signal Instructed Coordination In Cooperative Multi-agent Reinforcement Learning

Abstract

In many real-world problems, a team of agents need to collaborate to maximize the common reward. Although existing works formulate this problem into a centralized learning with decentralized execution framework, which avoids the non-stationary problem in training, their decentralized execution paradigm limits the agents' capability to coordinate. Inspired by the concept of correlated equilibrium, we propose to introduce a coordination signal to address this limitation, and theoretically show that following mild conditions, decentralized agents with the coordination signal can coordinate their individual policies as manipulated by a centralized controller. The idea of introducing coordination signal is to encapsulate coordinated strategies into the signals, and use the signals to instruct the collaboration in decentralized execution. To encourage agents to learn to exploit the coordination signal, we propose Signal Instructed Coordination (SIC), a novel coordination module that can be i

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keychen2019signal

Related papers

• Multi-agent Coordination In Adversarial Environments Through Signal Mediated Strategies (2021)2.26
• Promoting Coordination Through Policy Regularization In Multi-agent Deep Reinforcement Learning (2019)0.00
• Situation-dependent Causal Influence-based Cooperative Multi-agent Reinforcement Learning (2023)5.24
• GCS: Graph-based Coordination Strategy For Multi-agent Reinforcement Learning (2022)0.00
• Learning Multiagent Coordination In The Absence Of Communication Channels (2018)0.00
• Fully Decentralized Cooperative Multi-agent Reinforcement Learning: A Survey (2024)0.00
• Coordination-driven Learning In Multi-agent Problem Spaces (2018)0.00
• Coordinated Exploration Via Intrinsic Rewards For Multi-agent Reinforcement Learning (2019)0.00