Intelligent Problem-solving As Integrated Hierarchical Reinforcement Learning

Abstract

According to cognitive psychology and related disciplines, the development of complex problem-solving behaviour in biological agents depends on hierarchical cognitive mechanisms. Hierarchical reinforcement learning is a promising computational approach that may eventually yield comparable problem-solving behaviour in artificial agents and robots. However, to date the problem-solving abilities of many human and non-human animals are clearly superior to those of artificial systems. Here, we propose steps to integrate biologically inspired hierarchical mechanisms to enable advanced problem-solving skills in artificial agents. Therefore, we first review the literature in cognitive psychology to highlight the importance of compositional abstraction and predictive processing. Then we relate the gained insights with contemporary hierarchical reinforcement learning methods. Interestingly, our results suggest that all identified cognitive mechanisms have been implemented individually in isolate

Stats

• citations73
• S2 citations—
• github stars0
• HF likes0
• heat score14.02
• arxiv keyeppe2022intelligent

Related papers

• Hierarchical Principles Of Embodied Reinforcement Learning: A Review (2020)0.00
• Hierarchical Reinforcement Learning In Complex 3D Environments (2023)0.00
• RLOC: Neurobiologically Inspired Hierarchical Reinforcement Learning Algorithm For Continuous Control Of Nonlinear Dynamical Systems (2019)0.00
• Hierarchical Decision Making Based On Structural Information Principles (2024)0.00
• Subgoal-based Hierarchical Reinforcement Learning For Multi-agent Collaboration (2024)0.00
• Hierarchical Multi-agent Reinforcement Learning For Air Combat Maneuvering (2023)8.82
• Exploring The Limits Of Hierarchical World Models In Reinforcement Learning (2024)6.34
• Explaining Agent's Decision-making In A Hierarchical Reinforcement Learning Scenario (2022)0.00