Empirical Study On Robustness And Resilience In Cooperative Multi-agent Reinforcement Learning

Abstract

In cooperative Multi-Agent Reinforcement Learning (MARL), it is a common practice to tune hyperparameters in ideal simulated environments to maximize cooperative performance. However, policies tuned for cooperation often fail to maintain robustness and resilience under real-world uncertainties. Building trustworthy MARL systems requires a deep understanding of robustness, which ensures stability under uncertainties, and resilience, the ability to recover from disruptions--a concept extensively studied in control systems but largely overlooked in MARL. In this paper, we present a large-scale empirical study comprising over 82,620 experiments to evaluate cooperation, robustness, and resilience in MARL across 4 real-world environments, 13 uncertainty types, and 15 hyperparameters. Our key findings are: (1) Under mild uncertainty, optimizing cooperation improves robustness and resilience, but this link weakens as perturbations intensify. Robustness and resilience also varies by algorithm a

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyli2025empirical

Related papers

• Robust Multi-agent Reinforcement Learning With State Uncertainty (2023)0.00
• Collaboration Promotes Group Resilience In Multi-agent RL (2021)0.00
• Robustness To Multi-modal Environment Uncertainty In MARL Using Curriculum Learning (2023)0.00
• Robust Multi-agent Reinforcement Learning Via Adversarial Regularization: Theoretical Foundation And Stable Algorithms (2023)2.98
• Robust Multi-agent Reinforcement Learning By Mutual Information Regularization (2023)0.00
• Adaptability In Multi-agent Reinforcement Learning: A Framework And Unified Review (2025)0.00
• Breaking The Curse Of Multiagency In Robust Multi-agent Reinforcement Learning (2024)0.00
• How Much Can Change In A Year? Revisiting Evaluation In Multi-agent Reinforcement Learning (2023)0.00