Generalization Of Reinforcement Learning With Policy-aware Adversarial Data Augmentation

Abstract

The generalization gap in reinforcement learning (RL) has been a significant obstacle that prevents the RL agent from learning general skills and adapting to varying environments. Increasing the generalization capacity of the RL systems can significantly improve their performance on real-world working environments. In this work, we propose a novel policy-aware adversarial data augmentation method to augment the standard policy learning method with automatically generated trajectory data. Different from the commonly used observation transformation based data augmentations, our proposed method adversarially generates new trajectory data based on the policy gradient objective and aims to more effectively increase the RL agent's generalization ability with the policy-aware data augmentation. Moreover, we further deploy a mixup step to integrate the original and generated data to enhance the generalization capacity while mitigating the over-deviation of the adversarial data. We conduct expe

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhang2021generalization

Related papers

• Equivariant Data Augmentation For Generalization In Offline Reinforcement Learning (2023)0.00
• Model-based Offline Reinforcement Learning With Adversarial Data Augmentation (2025)0.00
• Learning Invariances For Policy Generalization (2018)0.00
• Adversarial Policies: Attacking Deep Reinforcement Learning (2019)0.00
• Understanding What Affects The Generalization Gap In Visual Reinforcement Learning: Theory And Empirical Evidence (2024)5.84
• Adversarial Style Transfer For Robust Policy Optimization In Deep Reinforcement Learning (2023)0.00
• Improving Generalization In Reinforcement Learning With Mixture Regularization (2020)0.00
• Policy Augmentation: An Exploration Strategy For Faster Convergence Of Deep Reinforcement Learning Algorithms (2021)2.26