Towards A Standardised Performance Evaluation Protocol For Cooperative MARL

Abstract

Multi-agent reinforcement learning (MARL) has emerged as a useful approach to solving decentralised decision-making problems at scale. Research in the field has been growing steadily with many breakthrough algorithms proposed in recent years. In this work, we take a closer look at this rapid development with a focus on evaluation methodologies employed across a large body of research in cooperative MARL. By conducting a detailed meta-analysis of prior work, spanning 75 papers accepted for publication from 2016 to 2022, we bring to light worrying trends that put into question the true rate of progress. We further consider these trends in a wider context and take inspiration from single-agent RL literature on similar issues with recommendations that remain applicable to MARL. Combining these recommendations, with novel insights from our analysis, we propose a standardised performance evaluation protocol for cooperative MARL. We argue that such a standard protocol, if widely adopted, woul

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keygorsane2022towards

Related papers

• How Much Can Change In A Year? Revisiting Evaluation In Multi-agent Reinforcement Learning (2023)0.00
• Benchmarking Multi-agent Deep Reinforcement Learning Algorithms In Cooperative Tasks (2020)0.00
• A Review Of Cooperative Multi-agent Deep Reinforcement Learning (2019)19.08
• Characterizing Speed Performance Of Multi-agent Reinforcement Learning (2023)4.52
• Dispelling The Mirage Of Progress In Offline MARL Through Standardised Baselines And Evaluation (2024)0.00
• Revisiting Some Common Practices In Cooperative Multi-agent Reinforcement Learning (2022)0.00
• Marllib: A Scalable And Efficient Multi-agent Reinforcement Learning Library (2022)0.00
• Benchmarl: Benchmarking Multi-agent Reinforcement Learning (2023)5.58