Reinforcement Learning With A Network Of Spiking Agents

Abstract

Neuroscientific theory suggests that dopaminergic neurons broadcast global reward prediction errors to large areas of the brain influencing the synaptic plasticity of the neurons in those regions. We build on this theory to propose a multi-agent learning framework with spiking neurons in the generalized linear model (GLM) formulation as agents, to solve reinforcement learning (RL) tasks. We show that a network of GLM spiking agents connected in a hierarchical fashion, where each spiking agent modulates its firing policy based on local information and a global prediction error, can learn complex action representations to solve RL tasks. We further show how leveraging principles of modularity and population coding inspired from the brain can help reduce variance in the learning updates making it a viable optimization technique.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyaenugu2019reinforcement

Related papers

• Learning Fast Changing Slow In Spiking Neural Networks (2024)3.58
• Learning To Control Dynamical Agents Via Spiking Neural Networks And Metropolis-hastings Sampling (2025)0.00
• Hebbian Synaptic Modifications In Spiking Neurons That Learn (2019)0.00
• Learning As Reinforcement: Applying Principles Of Neuroscience For More General Reinforcement Learning Agents (2020)0.00
• Deep Reinforcement Learning With Spiking Q-learning (2022)0.00
• Fully Spiking Actor Network With Intra-layer Connections For Reinforcement Learning (2024)0.00
• Evolving-to-learn Reinforcement Learning Tasks With Spiking Neural Networks (2022)0.00
• Multi-agent Reinforcement Learning In Stochastic Networked Systems (2020)0.00