RLIF: Interactive Imitation Learning As Reinforcement Learning

Abstract

Although reinforcement learning methods offer a powerful framework for automatic skill acquisition, for practical learning-based control problems in domains such as robotics, imitation learning often provides a more convenient and accessible alternative. In particular, an interactive imitation learning method such as DAgger, which queries a near-optimal expert to intervene online to collect correction data for addressing the distributional shift challenges that afflict na\"ive behavioral cloning, can enjoy good performance both in theory and practice without requiring manually specified reward functions and other components of full reinforcement learning methods. In this paper, we explore how off-policy reinforcement learning can enable improved performance under assumptions that are similar but potentially even more practical than those of interactive imitation learning. Our proposed method uses reinforcement learning with user intervention signals themselves as rewards. This relaxes

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyluo2023rlif

Related papers

• Inverse Reinforcement Learning Without Reinforcement Learning (2023)0.00
• Interactive And Hybrid Imitation Learning: Provably Beating Behavior Cloning (2024)0.00
• Imitation Learning From Observation With Automatic Discount Scheduling (2023)0.00
• Dual RL: Unification And New Methods For Reinforcement And Imitation Learning (2023)0.00
• Blending Imitation And Reinforcement Learning For Robust Policy Improvement (2023)0.00
• On Discovering Algorithms For Adversarial Imitation Learning (2025)0.00
• Diffail: Diffusion Adversarial Imitation Learning (2023)9.13
• A New Framework For Query Efficient Active Imitation Learning (2019)0.00