Good Better Best: Self-motivated Imitation Learning For Noisy Demonstrations

Abstract

Imitation Learning (IL) aims to discover a policy by minimizing the discrepancy between the agent's behavior and expert demonstrations. However, IL is susceptible to limitations imposed by noisy demonstrations from non-expert behaviors, presenting a significant challenge due to the lack of supplementary information to assess their expertise. In this paper, we introduce Self-Motivated Imitation LEarning (SMILE), a method capable of progressively filtering out demonstrations collected by policies deemed inferior to the current policy, eliminating the need for additional information. We utilize the forward and reverse processes of Diffusion Models to emulate the shift in demonstration expertise from low to high and vice versa, thereby extracting the noise information that diffuses expertise. Then, the noise information is leveraged to predict the diffusion steps between the current policy and demonstrators, which we theoretically demonstrate its equivalence to their expertise gap. We furt

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyyuan2023good

Related papers

• Beyond-expert Performance With Limited Demonstrations: Efficient Imitation Learning With Double Exploration (2025)0.00
• A Bayesian Solution To The Imitation Gap (2024)0.00
• Co-imitation Learning Without Expert Demonstration (2021)0.00
• State-only Imitation With Transition Dynamics Mismatch (2020)0.00
• Don't Start From Scratch: Behavioral Refinement Via Interpolant-based Policy Diffusion (2024)9.28
• Toward The Fundamental Limits Of Imitation Learning (2020)0.00
• A Dual Approach To Imitation Learning From Observations With Offline Datasets (2024)0.00
• Offline Imitation Learning With Suboptimal Demonstrations Via Relaxed Distribution Matching (2023)6.77