Causal Imitation Learning With Unobserved Confounders

Abstract

One of the common ways children learn is by mimicking adults. Imitation learning focuses on learning policies with suitable performance from demonstrations generated by an expert, with an unspecified performance measure, and unobserved reward signal. Popular methods for imitation learning start by either directly mimicking the behavior policy of an expert (behavior cloning) or by learning a reward function that prioritizes observed expert trajectories (inverse reinforcement learning). However, these methods rely on the assumption that covariates used by the expert to determine her/his actions are fully observed. In this paper, we relax this assumption and study imitation learning when sensory inputs of the learner and the expert differ. First, we provide a non-parametric, graphical criterion that is complete (both necessary and sufficient) for determining the feasibility of imitation from the combinations of demonstration data and qualitative assumptions about the underlying environmen

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhang2022causal

Related papers

• Sequential Causal Imitation Learning With Unobserved Confounders (2022)0.00
• Causal Confusion In Imitation Learning (2019)0.00
• Causal Imitation Learning Under Expert-observable And Expert-unobservable Confounding (2025)0.00
• Confounded Causal Imitation Learning With Instrumental Variables (2025)0.00
• Sequence Model Imitation Learning With Unobserved Contexts (2022)0.00
• Causal Imitation Learning Under Temporally Correlated Noise (2022)0.00
• Feedback In Imitation Learning: The Three Regimes Of Covariate Shift (2021)0.00
• Causal Imitation Learning Under Measurement Error And Distribution Shift (2026)0.00