Collective Explainable AI: Explaining Cooperative Strategies And Agent Contribution In Multiagent Reinforcement Learning With Shapley Values

Abstract

While Explainable Artificial Intelligence (XAI) is increasingly expanding more areas of application, little has been applied to make deep Reinforcement Learning (RL) more comprehensible. As RL becomes ubiquitous and used in critical and general public applications, it is essential to develop methods that make it better understood and more interpretable. This study proposes a novel approach to explain cooperative strategies in multiagent RL using Shapley values, a game theory concept used in XAI that successfully explains the rationale behind decisions taken by Machine Learning algorithms. Through testing common assumptions of this technique in two cooperation-centered socially challenging multi-agent environments environments, this article argues that Shapley values are a pertinent way to evaluate the contribution of players in a cooperative multi-agent RL context. To palliate the high overhead of this method, Shapley values are approximated using Monte Carlo sampling. Experimental res

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyheuillet2021collective

Related papers

• Explaining Reinforcement Learning With Shapley Values (2023)0.00
• A Theoretical Framework For Explaining Reinforcement Learning With Shapley Values (2025)0.00
• From Explainability To Interpretability: Interpretable Policies In Reinforcement Learning Via Model Explanation (2025)0.00
• Explaining Reinforcement Learning: A Counterfactual Shapley Values Approach (2024)0.00
• SHAQ: Incorporating Shapley Value Theory Into Multi-agent Q-learning (2021)0.00
• The Shapley Value In Machine Learning (2022)17.35
• MACIE: Multi-agent Causal Intelligence Explainer For Collective Behavior Understanding (2025)2.26
• Explainability In Deep Reinforcement Learning, A Review Into Current Methods And Applications (2022)12.33