Decomposing The Prediction Problem; Autonomous Navigation By Neorl Agents

Abstract

Navigating the world is a fundamental ability for any living entity. Accomplishing the same degree of freedom in technology has proven to be difficult. The brain is the only known mechanism capable of voluntary navigation, making neuroscience our best source of inspiration toward autonomy. Assuming that state representation is key, we explore the difference in how the brain and the machine represent the navigational state. Where Reinforcement Learning (RL) requires a monolithic state representation in accordance with the Markov property, Neural Representation of Euclidean Space (NRES) reflects navigational state via distributed activation patterns. We show how NRES-Oriented RL (neoRL) agents are possible before verifying our theoretical findings by experiments. Ultimately, neoRL agents are capable of behavior synthesis across state spaces -- allowing for decomposition of the problem into smaller spaces, alleviating the curse of dimensionality.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyleikanger2021decomposing

Related papers

• Ego-foresight: Self-supervised Learning Of Agent-aware Representations For Improved RL (2024)0.00
• Predicting Future Actions Of Reinforcement Learning Agents (2024)3.58
• Interpretable End-to-end Neurosymbolic Reinforcement Learning Agents (2024)0.00
• Unsupervised Predictive Memory In A Goal-directed Agent (2018)0.00
• From Two-dimensional To Three-dimensional Environment With Q-learning: Modeling Autonomous Navigation With Reinforcement Learning And No Libraries (2024)0.00
• Efficient Deep Reinforcement Learning With Predictive Processing Proximal Policy Optimization (2022)0.00
• Discovering Latent States For Model Learning: Applying Sensorimotor Contingencies Theory And Predictive Processing To Model Context (2016)0.00
• A Continual Offline Reinforcement Learning Benchmark For Navigation Tasks (2025)0.00