Multi-agent Deep Covering Skill Discovery

Abstract

The use of skills (a.k.a., options) can greatly accelerate exploration in reinforcement learning, especially when only sparse reward signals are available. While option discovery methods have been proposed for individual agents, in multi-agent reinforcement learning settings, discovering collaborative options that can coordinate the behavior of multiple agents and encourage them to visit the under-explored regions of their joint state space has not been considered. In this case, we propose Multi-agent Deep Covering Option Discovery, which constructs the multi-agent options through minimizing the expected cover time of the multiple agents' joint state space. Also, we propose a novel framework to adopt the multi-agent options in the MARL process. In practice, a multi-agent task can usually be divided into some sub-tasks, each of which can be completed by a sub-group of the agents. Therefore, our algorithm framework first leverages an attention mechanism to find collaborative agent sub-gr

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keychen2022multi

Related papers

• Hierarchical Cooperative Multi-agent Reinforcement Learning With Skill Discovery (2019)5.24
• A Review Of Cooperative Multi-agent Deep Reinforcement Learning (2019)19.08
• Coordinated Exploration Via Intrinsic Rewards For Multi-agent Reinforcement Learning (2019)0.00
• An Efficient Transfer Learning Framework For Multiagent Reinforcement Learning (2020)0.00
• MESA: Cooperative Meta-exploration In Multi-agent Learning Through Exploiting State-action Space Structure (2024)2.26
• An Autonomous Non-monolithic Agent With Multi-mode Exploration Based On Options Framework (2023)0.00
• Option Discovery In Hierarchical Reinforcement Learning Using Spatio-temporal Clustering (2016)0.00
• Individual Specialization In Multi-task Environments With Multiagent Reinforcement Learners (2019)0.00