Multi-agent Reinforcement Learning: A Selective Overview Of Theories And Algorithms

Abstract

Recent years have witnessed significant advances in reinforcement learning (RL), which has registered great success in solving various sequential decision-making problems in machine learning. Most of the successful RL applications, e.g., the games of Go and Poker, robotics, and autonomous driving, involve the participation of more than one single agent, which naturally fall into the realm of multi-agent RL (MARL), a domain with a relatively long history, and has recently re-emerged due to advances in single-agent RL techniques. Though empirically successful, theoretical foundations for MARL are relatively lacking in the literature. In this chapter, we provide a selective overview of MARL, with focus on algorithms backed by theoretical analysis. More specifically, we review the theoretical results of MARL algorithms mainly within two representative frameworks, Markov/stochastic games and extensive-form games, in accordance with the types of tasks they address, i.e., fully cooperative, f

Stats

• citations817
• S2 citations—
• github stars0
• HF likes0
• heat score21.85
• arxiv keyzhang2019multi

Related papers

• Game-theoretic Multiagent Reinforcement Learning (2020)0.00
• Multi-agent Reinforcement Learning: A Comprehensive Survey (2023)0.00
• Algorithms In Multi-agent Systems: A Holistic Perspective From Reinforcement Learning And Game Theory (2020)0.00
• A Review Of Cooperative Multi-agent Deep Reinforcement Learning (2019)19.08
• Model-based Multi-agent Reinforcement Learning: Recent Progress And Prospects (2022)0.00
• Multi-agent Reinforcement Learning: A Report On Challenges And Approaches (2018)0.00
• Decentralized Multi-agent Reinforcement Learning With Networked Agents: Recent Advances (2019)0.00
• A Comprehensive Review Of Multi-agent Reinforcement Learning In Video Games (2025)5.24