Learning Robust Rewards With Adversarial Inverse Reinforcement Learning

Abstract

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning methods can remove the need for explicit engineering of policy or value features, but still require a manually specified reward function. Inverse reinforcement learning holds the promise of automatic reward acquisition, but has proven exceptionally difficult to apply to large, high-dimensional problems with unknown dynamics. In this work, we propose adverserial inverse reinforcement learning (AIRL), a practical and scalable inverse reinforcement learning algorithm based on an adversarial reward learning formulation. We demonstrate that AIRL is able to recover reward functions that are robust to changes in dynamics, enabling us to learn policies even under significant variation in the environment seen during training. Our experiments show that AIRL greatly

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfu2017learning

Related papers

• Rethinking Adversarial Inverse Reinforcement Learning: Policy Imitation, Transferable Reward Recovery And Algebraic Equilibrium Proof (2024)0.00
• Adversarial Recovery Of Agent Rewards From Latent Spaces Of The Limit Order Book (2019)0.00
• Non-adversarial Imitation Learning And Its Connections To Adversarial Methods (2020)0.00
• Scalable Multi-agent Inverse Reinforcement Learning Via Actor-attention-critic (2020)0.00
• Enhancing Inverse Reinforcement Learning Through Encoding Dynamic Information In Reward Shaping (2024)0.00
• Active Exploration For Inverse Reinforcement Learning (2022)0.00
• Non-adversarial Inverse Reinforcement Learning Via Successor Feature Matching (2024)0.00
• Towards Theoretical Understanding Of Inverse Reinforcement Learning (2023)0.00