Reaching Consensus In Cooperative Multi-agent Reinforcement Learning With Goal Imagination

Abstract

Reaching consensus is key to multi-agent coordination. To accomplish a cooperative task, agents need to coherently select optimal joint actions to maximize the team reward. However, current cooperative multi-agent reinforcement learning (MARL) methods usually do not explicitly take consensus into consideration, which may cause miscoordination problem. In this paper, we propose a model-based consensus mechanism to explicitly coordinate multiple agents. The proposed Multi-agent Goal Imagination (MAGI) framework guides agents to reach consensus with an Imagined common goal. The common goal is an achievable state with high value, which is obtained by sampling from the distribution of future states. We directly model this distribution with a self-supervised generative model, thus alleviating the "curse of dimensinality" problem induced by multi-agent multi-step policy rollout commonly used in model-based methods. We show that such efficient consensus mechanism can guide all agents cooperati

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2024reaching

Related papers

• Self-supervised Goal-reaching Results In Multi-agent Cooperation And Exploration (2025)0.00
• Trust-based Consensus In Multi-agent Reinforcement Learning Systems (2022)0.00
• Communicating Plans, Not Percepts: Scalable Multi-agent Coordination With Embodied World Models (2025)0.00
• CPIG: Leveraging Consistency Policy With Intention Guidance For Multi-agent Exploration (2024)0.00
• Cautiously-optimistic Knowledge Sharing For Cooperative Multi-agent Reinforcement Learning (2023)5.84
• Towards Collaborative Intelligence: Propagating Intentions And Reasoning For Multi-agent Coordination With Large Language Models (2024)0.00
• Influence-based Reinforcement Learning For Intrinsically-motivated Agents (2021)0.00
• Policy Distillation And Value Matching In Multiagent Reinforcement Learning (2019)10.48