Adaptive Parameter Sharing For Multi-agent Reinforcement Learning

Abstract

Parameter sharing, as an important technique in multi-agent systems, can effectively solve the scalability issue in large-scale agent problems. However, the effectiveness of parameter sharing largely depends on the environment setting. When agents have different identities or tasks, naive parameter sharing makes it difficult to generate sufficiently differentiated strategies for agents. Inspired by research pertaining to the brain in biology, we propose a novel parameter sharing method. It maps each type of agent to different regions within a shared network based on their identity, resulting in distinct subnetworks. Therefore, our method can increase the diversity of strategies among different agents without introducing additional training parameters. Through experiments conducted in multiple environments, our method has shown better performance than other parameter sharing methods.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyli2023adaptive

Related papers

• Scaling Multi-agent Reinforcement Learning With Selective Parameter Sharing (2021)0.00
• Revisiting Parameter Sharing In Multi-agent Deep Reinforcement Learning (2020)0.00
• Parameter Sharing With Network Pruning For Scalable Multi-agent Deep Reinforcement Learning (2023)2.26
• Parameter Sharing Deep Deterministic Policy Gradient For Cooperative Multi-agent Reinforcement Learning (2017)0.00
• Improving Global Parameter-sharing In Physically Heterogeneous Multi-agent Reinforcement Learning With Unified Action Space (2024)0.00
• Kaleidoscope: Learnable Masks For Heterogeneous Multi-agent Reinforcement Learning (2024)2.26
• PPS-QMIX: Periodically Parameter Sharing For Accelerating Convergence Of Multi-agent Reinforcement Learning (2024)1.81
• Hypermarl: Adaptive Hypernetworks For Multi-agent RL (2024)0.00