Resolving Spurious Correlations In Causal Models Of Environments Via Interventions

Abstract

Causal models bring many benefits to decision-making systems (or agents) by making them interpretable, sample-efficient, and robust to changes in the input distribution. However, spurious correlations can lead to wrong causal models and predictions. We consider the problem of inferring a causal model of a reinforcement learning environment and we propose a method to deal with spurious correlations. Specifically, our method designs a reward function that incentivizes an agent to do an intervention to find errors in the causal model. The data obtained from doing the intervention is used to improve the causal model. We propose several intervention design methods and compare them. The experimental results in a grid-world environment show that our approach leads to better causal models compared to baselines: learning the model on data from a random policy or a policy trained on the environment's reward. The main contribution consists of methods to design interventions to resolve spurious co

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyvolodin2020resolving

Related papers

• Towards Intervention-centric Causal Reasoning In Learning Agents (2020)0.00
• Causal Reinforcement Learning Using Observational And Interventional Data (2021)0.00
• Learning By Doing: An Online Causal Reinforcement Learning Framework With Causal-aware Policy (2024)1.56
• Learning Nonlinear Causal Reductions To Explain Reinforcement Learning Policies (2025)0.00
• Boosting Efficiency In Task-agnostic Exploration Through Causal Knowledge (2024)0.00
• Learning Causal Overhypotheses Through Exploration In Children And Computational Models (2022)0.00
• Explainable Reinforcement Learning Through A Causal Lens (2019)16.69
• Empowerment Gain And Causal Model Construction: Children And Adults Are Sensitive To Controllability And Variability In Their Causal Interventions (2025)0.00