Optimization For Reinforcement Learning: From Single Agent To Cooperative Agents

Abstract

This article reviews recent advances in multi-agent reinforcement learning algorithms for large-scale control systems and communication networks, which learn to communicate and cooperate. We provide an overview of this emerging field, with an emphasis on the decentralized setting under different coordination protocols. We highlight the evolution of reinforcement learning algorithms from single-agent to multi-agent systems, from a distributed optimization perspective, and conclude with future directions and challenges, in the hope to catalyze the growing synergy among distributed optimization, signal processing, and reinforcement learning communities.

Stats

• citations88
• S2 citations—
• github stars0
• HF likes0
• heat score14.62
• arxiv keylee2019optimization

Related papers

• Fully Decentralized Cooperative Multi-agent Reinforcement Learning: A Survey (2024)0.00
• A Review Of Cooperative Multi-agent Deep Reinforcement Learning (2019)19.08
• Decentralized Multi-agent Reinforcement Learning With Networked Agents: Recent Advances (2019)0.00
• Deep Multiagent Reinforcement Learning: Challenges And Directions (2021)0.00
• Modeling Sensorimotor Coordination As Multi-agent Reinforcement Learning With Differentiable Communication (2019)0.00
• Strategic Coordination For Evolving Multi-agent Systems: A Hierarchical Reinforcement And Collective Learning Approach (2025)0.00
• Improved Reinforcement Learning In Cooperative Multi-agent Environments Using Knowledge Transfer (2021)0.00
• Multi-agent Actor-critic For Mixed Cooperative-competitive Environments (2017)0.00