Empowerment Gain And Causal Model Construction: Children And Adults Are Sensitive To Controllability And Variability In Their Causal Interventions

Abstract

Learning about the causal structure of the world is a fundamental problem for human cognition. Causal models and especially causal learning have proved to be difficult for large pretrained models using standard techniques of deep learning. In contrast, cognitive scientists have applied advances in our formal understanding of causation in computer science, particularly within the Causal Bayes Net formalism, to understand human causal learning. In the very different tradition of reinforcement learning, researchers have described an intrinsic reward signal called "empowerment" which maximizes mutual information between actions and their outcomes. "Empowerment" may be an important bridge between classical Bayesian causal learning and reinforcement learning and may help to characterize causal learning in humans and enable it in machines. If an agent learns an accurate causal world model, they will necessarily increase their empowerment, and increasing empowerment will lead to a more accurat

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyyiu2025empowerment

Related papers

• Towards Empowerment Gain Through Causal Structure Learning In Model-based RL (2025)0.00
• Disentangled Representations For Causal Cognition (2024)4.52
• Explainable Reinforcement Learning Through A Causal Lens (2019)16.69
• Learning Causal Overhypotheses Through Exploration In Children And Computational Models (2022)0.00
• Resolving Spurious Correlations In Causal Models Of Environments Via Interventions (2020)0.00
• Learning By Doing: An Online Causal Reinforcement Learning Framework With Causal-aware Policy (2024)1.56
• Towards Intervention-centric Causal Reasoning In Learning Agents (2020)0.00
• Why Online Reinforcement Learning Is Causal (2024)0.00