Robust Deep Reinforcement Learning Through Bootstrapped Opportunistic Curriculum

Abstract

Despite considerable advances in deep reinforcement learning, it has been shown to be highly vulnerable to adversarial perturbations to state observations. Recent efforts that have attempted to improve adversarial robustness of reinforcement learning can nevertheless tolerate only very small perturbations, and remain fragile as perturbation size increases. We propose Bootstrapped Opportunistic Adversarial Curriculum Learning (BCL), a novel flexible adversarial curriculum learning framework for robust reinforcement learning. Our framework combines two ideas: conservatively bootstrapping each curriculum phase with highest quality solutions obtained from multiple runs of the previous phase, and opportunistically skipping forward in the curriculum. In our experiments we show that the proposed BCL framework enables dramatic improvements in robustness of learned policies to adversarial perturbations. The greatest improvement is for Pong, where our framework yields robustness to perturbations

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywu2022robust

Related papers

• Robust Deep Reinforcement Learning Through Adversarial Loss (2020)0.00
• Robust Deep Reinforcement Learning With Adaptive Adversarial Perturbations In Action Space (2024)6.20
• Robust Model-based Reinforcement Learning With An Adversarial Auxiliary Model (2024)0.00
• Distributionally Robust Self Paced Curriculum Reinforcement Learning (2025)0.00
• Robust Reinforcement Learning On State Observations With Learned Optimal Adversary (2021)0.00
• Efficient Adversarial Training Without Attacking: Worst-case-aware Robust Reinforcement Learning (2022)0.00
• Curricula For Learning Robust Policies With Factored State Representations In Changing Environments (2024)0.00
• Robust Deep Reinforcement Learning Through Adversarial Attacks And Training : A Survey (2024)0.00