S2act: Simple Spiking Actor

Abstract

Spiking neural networks (SNNs) and biologically-inspired learning mechanisms are attractive in mobile robotics, where the size and performance of onboard neural network policies are constrained by power and computational budgets. Existing SNN approaches, such as population coding, reward modulation, and hybrid artificial neural network (ANN)-SNN architectures, have shown promising results; however, they face challenges in complex, highly stochastic environments due to SNN sensitivity to hyperparameters and inconsistent gradient signals. To address these challenges, we propose simple spiking actor (S2Act), a computationally lightweight framework that deploys an RL policy using an SNN in three steps: (1) architect an actor-critic model based on an approximated network of rate-based spiking neurons, (2) train the network with gradients using compatible activation functions, and (3) transfer the trained weights into physical parameters of rate-based leaky integrate-and-fire (LIF) neurons f

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyakcal2026s2act

Related papers

• Fully Spiking Actor Network With Intra-layer Connections For Reinforcement Learning (2024)0.00
• Population-coding And Dynamic-neurons Improved Spiking Actor Network For Reinforcement Learning (2021)0.00
• Learning First-to-spike Policies For Neuromorphic Control Using Policy Gradients (2018)8.60
• Deep Reinforcement Learning With Spiking Q-learning (2022)0.00
• Noisy Spiking Actor Network For Exploration (2024)0.00
• Learning To Control Dynamical Agents Via Spiking Neural Networks And Metropolis-hastings Sampling (2025)0.00
• Deep Reinforcement Learning With Population-coded Spiking Neural Network For Continuous Control (2020)0.00
• Adaptive Surrogate Gradients For Sequential Reinforcement Learning In Spiking Neural Networks (2025)0.00