Shared Experience Actor-critic For Multi-agent Reinforcement Learning

Abstract

Exploration in multi-agent reinforcement learning is a challenging problem, especially in environments with sparse rewards. We propose a general method for efficient exploration by sharing experience amongst agents. Our proposed algorithm, called Shared Experience Actor-Critic (SEAC), applies experience sharing in an actor-critic framework. We evaluate SEAC in a collection of sparse-reward multi-agent environments and find that it consistently outperforms two baselines and two state-of-the-art algorithms by learning in fewer steps and converging to higher returns. In some harder environments, experience sharing makes the difference between learning to solve the task and not learning at all.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keychristianos2020shared

Related papers

• Experience Sharing Between Cooperative Reinforcement Learning Agents (2019)0.00
• Actor-attention-critic For Multi-agent Reinforcement Learning (2018)0.00
• Multi-agent Actor-critic For Mixed Cooperative-competitive Environments (2017)0.00
• Selectively Sharing Experiences Improves Multi-agent Reinforcement Learning (2023)4.61
• Settling Decentralized Multi-agent Coordinated Exploration By Novelty Sharing (2024)4.52
• Boosting Exploration In Actor-critic Algorithms By Incentivizing Plausible Novel States (2022)5.24
• Coordinated Exploration Via Intrinsic Rewards For Multi-agent Reinforcement Learning (2019)0.00
• Sample Efficient Actor-critic With Experience Replay (2016)0.00