Discovering Latent States For Model Learning: Applying Sensorimotor Contingencies Theory And Predictive Processing To Model Context

Abstract

Autonomous robots need to be able to adapt to unforeseen situations and to acquire new skills through trial and error. Reinforcement learning in principle offers a suitable methodological framework for this kind of autonomous learning. However current computational reinforcement learning agents mostly learn each individual skill entirely from scratch. How can we enable artificial agents, such as robots, to acquire some form of generic knowledge, which they could leverage for the learning of new skills? This paper argues that, like the brain, the cognitive system of artificial agents has to develop a world model to support adaptive behavior and learning. Inspiration is taken from two recent developments in the cognitive science literature: predictive processing theories of cognition, and the sensorimotor contingencies theory of perception. Based on these, a hypothesis is formulated about what the content of information might be that is encoded in an internal world model, and how an agen

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhemion2016discovering

Related papers

• Partial Models For Building Adaptive Model-based Reinforcement Learning Agents (2024)0.00
• Dream To Explore: Adaptive Simulations For Autonomous Systems (2021)0.00
• Embedded Universal Predictive Intelligence: A Coherent Framework For Multi-agent Learning (2025)0.00
• Learning To Predict Without Looking Ahead: World Models Without Forward Prediction (2019)0.00
• Ego-foresight: Self-supervised Learning Of Agent-aware Representations For Improved RL (2024)0.00
• Intrinsic Motivation In Model-based Reinforcement Learning: A Brief Review (2023)0.00
• Prototypical Context-aware Dynamics Generalization For High-dimensional Model-based Reinforcement Learning (2022)0.00
• Reasoning About Unforeseen Possibilities During Policy Learning (2018)0.00