No Prior Mask: Eliminate Redundant Action For Deep Reinforcement Learning

Abstract

The large action space is one fundamental obstacle to deploying Reinforcement Learning methods in the real world. The numerous redundant actions will cause the agents to make repeated or invalid attempts, even leading to task failure. Although current algorithms conduct some initial explorations for this issue, they either suffer from rule-based systems or depend on expert demonstrations, which significantly limits their applicability in many real-world settings. In this work, we examine the theoretical analysis of what action can be eliminated in policy optimization and propose a novel redundant action filtering mechanism. Unlike other works, our method constructs the similarity factor by estimating the distance between the state distributions, which requires no prior knowledge. In addition, we combine the modified inverse model to avoid extensive computation in high-dimensional state space. We reveal the underlying structure of action spaces and propose a simple yet efficient redunda

Stats

• citations0
• S2 citations—
• github stars7
• HF likes0
• heat score1.81
• arxiv keyzhong2023no

Related papers

• Reducing Action Space For Deep Reinforcement Learning Via Causal Effect Estimation (2025)0.00
• Excluding The Irrelevant: Focusing Reinforcement Learning Through Continuous Action Masking (2024)4.52
• Achieving Sample And Computational Efficient Reinforcement Learning By Action Space Reduction Via Grouping (2023)0.00
• Data-driven Evaluation Of Training Action Space For Reinforcement Learning (2022)0.00
• Reinforcement Learning With Sparse-executing Actions Via Sparsity Regularization (2021)0.00
• Handling Cost And Constraints With Off-policy Deep Reinforcement Learning (2023)0.00
• Action Redundancy In Reinforcement Learning (2021)0.00
• Enhancing Control Policy Smoothness By Aligning Actions With Predictions From Preceding States (2026)0.00