GRSN: Gated Recurrent Spiking Neurons For Pomdps And MARL

Abstract

Spiking neural networks (SNNs) are widely applied in various fields due to their energy-efficient and fast-inference capabilities. Applying SNNs to reinforcement learning (RL) can significantly reduce the computational resource requirements for agents and improve the algorithm's performance under resource-constrained conditions. However, in current spiking reinforcement learning (SRL) algorithms, the simulation results of multiple time steps can only correspond to a single-step decision in RL. This is quite different from the real temporal dynamics in the brain and also fails to fully exploit the capacity of SNNs to process temporal data. In order to address this temporal mismatch issue and further take advantage of the inherent temporal dynamics of spiking neurons, we propose a novel temporal alignment paradigm (TAP) that leverages the single-step update of spiking neurons to accumulate historical state information in RL and introduces gated units to enhance the memory capacity of spi

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keyqin2024grsn

Related papers

• Adaptive Surrogate Gradients For Sequential Reinforcement Learning In Spiking Neural Networks (2025)0.00
• A Low Latency Adaptive Coding Spiking Framework For Deep Reinforcement Learning (2022)7.16
• Deep Reinforcement Learning With Spiking Q-learning (2022)0.00
• Population-coding And Dynamic-neurons Improved Spiking Actor Network For Reinforcement Learning (2021)0.00
• Reinforcement Learning With A Network Of Spiking Agents (2019)0.00
• Learning First-to-spike Policies For Neuromorphic Control Using Policy Gradients (2018)8.60
• Learning To Control Dynamical Agents Via Spiking Neural Networks And Metropolis-hastings Sampling (2025)0.00
• Fully Spiking Actor Network With Intra-layer Connections For Reinforcement Learning (2024)0.00