Enhancing Heterogeneous Multi-agent Cooperation In Decentralized MARL Via Gnn-driven Intrinsic Rewards

Abstract

Multi-agent Reinforcement Learning (MARL) is emerging as a key framework for various sequential decision-making and control tasks. Unlike their single-agent counterparts, multi-agent systems necessitate successful cooperation among the agents. The deployment of these systems in real-world scenarios often requires decentralized training, a diverse set of agents, and learning from infrequent environmental reward signals. These challenges become more pronounced under partial observability and the lack of prior knowledge about agent heterogeneity. While notable studies use intrinsic motivation (IM) to address reward sparsity or cooperation in decentralized settings, those dealing with heterogeneity typically assume centralized training, parameter sharing, and agent indexing. To overcome these limitations, we propose the CoHet algorithm, which utilizes a novel Graph Neural Network (GNN) based intrinsic motivation to facilitate the learning of heterogeneous agent policies in decentralized se

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymonon2024enhancing

Related papers

• Cooperative Policy Learning With Pre-trained Heterogeneous Observation Representations (2020)0.00
• Heterogeneous Multi-robot Reinforcement Learning (2023)6.77
• Hypermarl: Adaptive Hypernetworks For Multi-agent RL (2024)0.00
• Heterogeneous-agent Reinforcement Learning (2023)0.00
• Fully Decentralized Multi-agent Reinforcement Learning With Networked Agents (2018)0.00
• Maximum Entropy Heterogeneous-agent Reinforcement Learning (2023)0.00
• Self-clustering Hierarchical Multi-agent Reinforcement Learning With Extensible Cooperation Graph (2024)2.26
• Mean-field Multi-agent Reinforcement Learning: A Decentralized Network Approach (2021)0.00