Fidelity-induced Interpretable Policy Extraction For Reinforcement Learning

Abstract

Deep Reinforcement Learning (DRL) has achieved remarkable success in sequential decision-making problems. However, existing DRL agents make decisions in an opaque fashion, hindering the user from establishing trust and scrutinizing weaknesses of the agents. While recent research has developed Interpretable Policy Extraction (IPE) methods for explaining how an agent takes actions, their explanations are often inconsistent with the agent's behavior and thus, frequently fail to explain. To tackle this issue, we propose a novel method, Fidelity-Induced Policy Extraction (FIPE). Specifically, we start by analyzing the optimization mechanism of existing IPE methods, elaborating on the issue of ignoring consistency while increasing cumulative rewards. We then design a fidelity-induced mechanism by integrate a fidelity measurement into the reinforcement learning feedback. We conduct experiments in the complex control environment of StarCraft II, an arena typically avoided by current IPE method

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyliu2023fidelity

Related papers

• "so, Tell Me About Your Policy...": Distillation Of Interpretable Policies From Deep Reinforcement Learning Agents (2025)0.00
• Verifiable Reinforcement Learning Via Policy Extraction (2018)0.00
• From Explainability To Interpretability: Interpretable Policies In Reinforcement Learning Via Model Explanation (2025)0.00
• Reevaluating Policy Gradient Methods For Imperfect-information Games (2025)0.00
• Experiential Explanations For Reinforcement Learning (2022)2.26
• Blending Imitation And Reinforcement Learning For Robust Policy Improvement (2023)0.00
• Evolution-guided Policy Gradient In Reinforcement Learning (2018)0.00
• Evaluating Interpretable Reinforcement Learning By Distilling Policies Into Programs (2025)0.00