Lifelong Reinforcement Learning Via Neuromodulation

Abstract

Navigating multiple tasks\(\unicode\{x2014\}\)for instance in succession as in continual or lifelong learning, or in distributions as in meta or multi-task learning\(\unicode\{x2014\}\)requires some notion of adaptation. Evolution over timescales of millennia has imbued humans and other animals with highly effective adaptive learning and decision-making strategies. Central to these functions are so-called neuromodulatory systems. In this work we introduce an abstract framework for integrating theories and evidence from neuroscience and the cognitive sciences into the design of adaptive artificial reinforcement learning algorithms. We give a concrete instance of this framework built on literature surrounding the neuromodulators Acetylcholine (ACh) and Noradrenaline (NA), and empirically validate the effectiveness of the resulting adaptive algorithm in a non-stationary multi-armed bandit problem. We conclude with a theory-based experiment proposal providing an avenue to link our framewor

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylee2024lifelong

Related papers

• Context Meta-reinforcement Learning Via Neuromodulation (2021)6.34
• Reinforcement Learning With Brain-inspired Modulation Can Improve Adaptation To Environmental Changes (2022)0.00
• Modular Continual Learning In A Unified Visual Environment (2017)0.00
• Meta-reinforcement Learning With Self-modifying Networks (2022)4.52
• Deep Online Learning Via Meta-learning: Continual Adaptation For Model-based RL (2018)0.00
• Lifelong Reinforcement Learning With Modulating Masks (2022)0.00
• Adapting Behaviour For Learning Progress (2019)0.00
• Noise-based Reward-modulated Learning (2025)0.00