Towards Biologically Plausible Dreaming And Planning In Recurrent Spiking Networks

Abstract

Humans and animals can learn new skills after practicing for a few hours, while current reinforcement learning algorithms require a large amount of data to achieve good performances. Recent model-based approaches show promising results by reducing the number of necessary interactions with the environment to learn a desirable policy. However, these methods require biological implausible ingredients, such as the detailed storage of older experiences, and long periods of offline learning. The optimal way to learn and exploit word-models is still an open question. Taking inspiration from biology, we suggest that dreaming might be an efficient expedient to use an inner model. We propose a two-module (agent and model) spiking neural network in which "dreaming" (living new experiences in a model-based simulated environment) significantly boosts learning. We also explore "planning", an online alternative to dreaming, that shows comparable performances. Importantly, our model does not require t

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keycapone2022towards

Related papers

• Neuromorphic Dreaming: A Pathway To Efficient Learning In Artificial Agents (2024)0.00
• Reinforcement Learning With A Network Of Spiking Agents (2019)0.00
• Learning Fast Changing Slow In Spiking Neural Networks (2024)3.58
• Do Agents Dream Of Electric Sheep?: Improving Generalization In Reinforcement Learning Through Generative Learning (2024)0.00
• Dream To Control: Learning Behaviors By Latent Imagination (2019)0.00
• Bridging Imagination And Reality For Model-based Deep Reinforcement Learning (2020)0.00
• Learning As Reinforcement: Applying Principles Of Neuroscience For More General Reinforcement Learning Agents (2020)0.00
• Evolving-to-learn Reinforcement Learning Tasks With Spiking Neural Networks (2022)0.00