Abstracted Trajectory Visualization For Explainability In Reinforcement Learning

Abstract

Explainable AI (XAI) has demonstrated the potential to help reinforcement learning (RL) practitioners to understand how RL models work. However, XAI for users who do not have RL expertise (non-RL experts), has not been studied sufficiently. This results in a difficulty for the non-RL experts to participate in the fundamental discussion of how RL models should be designed for an incoming society where humans and AI coexist. Solving such a problem would enable RL experts to communicate with the non-RL experts in producing machine learning solutions that better fit our society. We argue that abstracted trajectories, that depicts transitions between the major states of the RL model, will be useful for non-RL experts to build a mental model of the agents. Our early results suggest that by leveraging a visualization of the abstracted trajectories, users without RL expertise are able to infer the behavior patterns of RL.

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keytakagi2024abstracted

Related papers

• Explainability In Deep Reinforcement Learning (2020)0.00
• Explainable Reinforcement Learning: A Survey (2020)0.00
• Explainable Artificial Intelligence (XAI) For Increasing User Trust In Deep Reinforcement Learning Driven Autonomous Systems (2021)0.00
• Explaining RL Decisions With Trajectories (2023)0.00
• Utilizing Explainability Techniques For Reinforcement Learning Model Assurance (2023)2.16
• A Survey Of Explainable Reinforcement Learning: Targets, Methods And Needs (2025)0.00
• Explainable Reinforcement Learning Agents Using World Models (2025)0.00
• Explainable Reinforcement Learning For Broad-xai: A Conceptual Framework And Survey (2021)0.00