Efficient Distributed Framework For Collaborative Multi-agent Reinforcement Learning

Abstract

Multi-agent reinforcement learning for incomplete information environments has attracted extensive attention from researchers. However, due to the slow sample collection and poor sample exploration, there are still some problems in multi-agent reinforcement learning, such as unstable model iteration and low training efficiency. Moreover, most of the existing distributed framework are proposed for single-agent reinforcement learning and not suitable for multi-agent. In this paper, we design an distributed MARL framework based on the actor-work-learner architecture. In this framework, multiple asynchronous environment interaction modules can be deployed simultaneously, which greatly improves the sample collection speed and sample diversity. Meanwhile, to make full use of computing resources, we decouple the model iteration from environment interaction, and thus accelerate the policy iteration. Finally, we verified the effectiveness of propose framework in MaCA military simulation environ

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyqi2022efficient

Related papers

• Marllib: A Scalable And Efficient Multi-agent Reinforcement Learning Library (2022)0.00
• A Review Of Cooperative Multi-agent Deep Reinforcement Learning (2019)19.08
• Individual Specialization In Multi-task Environments With Multiagent Reinforcement Learners (2019)0.00
• Collaborative Adaptation For Recovery From Unforeseen Malfunctions In Discrete And Continuous MARL Domains (2024)3.58
• Malib: A Parallel Framework For Population-based Multi-agent Reinforcement Learning (2021)0.00
• Multi-agent Reinforcement Learning In Stochastic Networked Systems (2020)0.00
• Fully Decentralized Multi-agent Reinforcement Learning With Networked Agents (2018)0.00
• An Initial Introduction To Cooperative Multi-agent Reinforcement Learning (2024)0.00