Interactive Visualization For Debugging RL

Abstract

Visualization tools for supervised learning allow users to interpret, introspect, and gain an intuition for the successes and failures of their models. While reinforcement learning practitioners ask many of the same questions, existing tools are not applicable to the RL setting as these tools address challenges typically found in the supervised learning regime. In this work, we design and implement an interactive visualization tool for debugging and interpreting RL algorithms. Our system addresses many features missing from previous tools such as (1) tools for supervised learning often are not interactive; (2) while debugging RL policies researchers use state representations that are different from those seen by the agent; (3) a framework designed to make the debugging RL policies more conducive. We provide an example workflow of how this system could be used, along with ideas for future extensions.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keydeshpande2020interactive

Related papers

• REVEAL-IT: Reinforcement Learning With Visibility Of Evolving Agent Policy For Interpretability (2024)0.00
• Interpretable Learning Dynamics In Unsupervised Reinforcement Learning (2025)0.00
• Abstracted Trajectory Visualization For Explainability In Reinforcement Learning (2024)2.26
• A Survey On Interpretable Reinforcement Learning (2021)0.00
• Can You See How I Learn? Human Observers' Inferences About Reinforcement Learning Agents' Learning Processes (2025)0.00
• Toybox: A Suite Of Environments For Experimental Evaluation Of Deep Reinforcement Learning (2019)0.00
• Explaining Conditions For Reinforcement Learning Behaviors From Real And Imagined Data (2020)0.00
• Efficient Multi-turn RL For GUI Agents Via Decoupled Training And Adaptive Data Curation (2025)0.00