Multi-agent Cooperative Games Using Belief Map Assisted Training

Abstract

In a multi-agent system, agents share their local observations to gain global situational awareness for decision making and collaboration using a message passing system. When to send a message, how to encode a message, and how to leverage the received messages directly affect the effectiveness of the collaboration among agents. When training a multi-agent cooperative game using reinforcement learning (RL), the message passing system needs to be optimized together with the agent policies. This consequently increases the model's complexity and poses significant challenges to the convergence and performance of learning. To address this issue, we propose the Belief-map Assisted Multi-agent System (BAMS), which leverages a neuro-symbolic belief map to enhance training. The belief map decodes the agent's hidden state to provide a symbolic representation of the agent's understanding of the environment and other agent's status. The simplicity of symbolic representation allows the gathering and

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhuang2024multi

Related papers

• Generalized Beliefs For Cooperative AI (2022)0.00
• Belief States For Cooperative Multi-agent Reinforcement Learning Under Partial Observability (2025)0.00
• Fact-based Agent Modeling For Multi-agent Reinforcement Learning (2023)0.00
• Improved Reinforcement Learning In Cooperative Multi-agent Environments Using Knowledge Transfer (2021)0.00
• Learning In Cooperative Multiagent Systems Using Cognitive And Machine Models (2023)7.81
• Hybrid Belief Reinforcement Learning For Efficient Coordinated Spatial Exploration (2026)0.00
• Cooperative And Competitive Biases For Multi-agent Reinforcement Learning (2021)2.26
• Cautiously-optimistic Knowledge Sharing For Cooperative Multi-agent Reinforcement Learning (2023)5.84