RICE: Breaking Through The Training Bottlenecks Of Reinforcement Learning With Explanation

Abstract

Deep reinforcement learning (DRL) is playing an increasingly important role in real-world applications. However, obtaining an optimally performing DRL agent for complex tasks, especially with sparse rewards, remains a significant challenge. The training of a DRL agent can be often trapped in a bottleneck without further progress. In this paper, we propose RICE, an innovative refining scheme for reinforcement learning that incorporates explanation methods to break through the training bottlenecks. The high-level idea of RICE is to construct a new initial state distribution that combines both the default initial states and critical states identified through explanation methods, thereby encouraging the agent to explore from the mixed initial states. Through careful design, we can theoretically guarantee that our refining scheme has a tighter sub-optimality bound. We evaluate RICE in various popular RL environments and real-world applications. The results demonstrate that RICE significantl

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keycheng2024rice

Related papers

• Explainability In Deep Reinforcement Learning, A Review Into Current Methods And Applications (2022)12.33
• Redefining Counterfactual Explanations For Reinforcement Learning: Overview, Challenges And Opportunities (2022)0.00
• Causal State Distillation For Explainable Reinforcement Learning (2023)0.00
• RACCER: Towards Reachable And Certain Counterfactual Explanations For Reinforcement Learning (2023)0.00
• Experiential Explanations For Reinforcement Learning (2022)2.26
• Reccover: Detecting Causal Confusion For Explainable Reinforcement Learning (2022)0.00
• A Survey On Explainable Reinforcement Learning: Concepts, Algorithms, Challenges (2022)0.00
• Random Latent Exploration For Deep Reinforcement Learning (2024)0.00