An Introduction To Reinforcement Learning For Neuroscience

Abstract

Reinforcement learning (RL) has a rich history in neuroscience, from early work on dopamine as a reward prediction error signal (Schultz et al., 1997) to recent work proposing that the brain could implement a form of 'distributional reinforcement learning' popularized in machine learning (Dabney et al., 2020). There has been a close link between theoretical advances in reinforcement learning and neuroscience experiments throughout this literature, and the theories describing the experimental data have therefore become increasingly complex. Here, we provide an introduction and mathematical background to many of the methods that have been used in systems neroscience. We start with an overview of the RL problem and classical temporal difference algorithms, followed by a discussion of 'model-free', 'model-based', and intermediate RL algorithms. We then introduce deep reinforcement learning and discuss how this framework has led to new insights in neuroscience. This includes a particular fo

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keyjensen2023an

Related papers

• Reinforcement Learning And Its Connections With Neuroscience And Psychology (2020)12.25
• A Learning Gap Between Neuroscience And Reinforcement Learning (2021)0.00
• Dopamine: A Research Framework For Deep Reinforcement Learning (2018)0.00
• On The Reliability And Generalizability Of Brain-inspired Reinforcement Learning Algorithms (2020)0.00
• Learning Sparse Representations In Reinforcement Learning (2019)0.00
• Learning As Reinforcement: Applying Principles Of Neuroscience For More General Reinforcement Learning Agents (2020)0.00
• Reinforcement Learning With Brain-inspired Modulation Can Improve Adaptation To Environmental Changes (2022)0.00
• Modern Deep Reinforcement Learning Algorithms (2019)0.00