Causal Transfer For Imitation Learning And Decision Making Under Sensor-shift

Abstract

Learning from demonstrations (LfD) is an efficient paradigm to train AI agents. But major issues arise when there are differences between (a) the demonstrator's own sensory input, (b) our sensors that observe the demonstrator and (c) the sensory input of the agent we train. In this paper, we propose a causal model-based framework for transfer learning under such "sensor-shifts", for two common LfD tasks: (1) inferring the effect of the demonstrator's actions and (2) imitation learning. First we rigorously analyze, on the population-level, to what extent the relevant underlying mechanisms (the action effects and the demonstrator policy) can be identified and transferred from the available observations together with prior knowledge of sensor characteristics. And we device an algorithm to infer these mechanisms. Then we introduce several proxy methods which are easier to calculate, estimate from finite data and interpret than the exact solutions, alongside theoretical bounds on their clos

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keyetesami2020causal

Related papers

• Feedback In Imitation Learning: The Three Regimes Of Covariate Shift (2021)0.00
• Causal Imitation Learning Under Measurement Error And Distribution Shift (2026)0.00
• Causal Confusion In Imitation Learning (2019)0.00
• Imitation Learning From Observations By Minimizing Inverse Dynamics Disagreement (2019)0.00
• A Bayesian Approach To Policy Recognition And State Representation Learning (2016)3.58
• A Dual Approach To Imitation Learning From Observations With Offline Datasets (2024)0.00
• Causal Imitation Learning With Unobserved Confounders (2022)0.00
• Transfer Learning Across Simulated Robots With Different Sensors (2019)0.00