Distilling Neuron Spike With High Temperature In Reinforcement Learning Agents

Abstract

Spiking neural network (SNN), compared with depth neural network (DNN), has faster processing speed, lower energy consumption and more biological interpretability, which is expected to approach Strong AI. Reinforcement learning is similar to learning in biology. It is of great significance to study the combination of SNN and RL. We propose the reinforcement learning method of spike distillation network (SDN) with STBP. This method uses distillation to effectively avoid the weakness of STBP, which can achieve SOTA performance in classification, and can obtain a smaller, faster convergence and lower power consumption SNN reinforcement learning model. Experiments show that our method can converge faster than traditional SNN reinforcement learning and DNN reinforcement learning methods, about 1000 epochs faster, and obtain SNN 200 times smaller than DNN. We also deploy SDN to the PKU nc64c chip, which proves that SDN has lower power consumption than DNN, and the power consumption of SDN is

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhang2021distilling

Related papers

• Deep Reinforcement Learning With Spiking Q-learning (2022)0.00
• Human-level Control Through Directly-trained Deep Spiking Q-networks (2021)12.40
• Fully Spiking Actor Network With Intra-layer Connections For Reinforcement Learning (2024)0.00
• A Low Latency Adaptive Coding Spiking Framework For Deep Reinforcement Learning (2022)7.16
• Energy-efficient Deep Reinforcement Learning With Spiking Transformers (2025)2.26
• Population-coding And Dynamic-neurons Improved Spiking Actor Network For Reinforcement Learning (2021)0.00
• Hardware-aware Fine-tuning Of Spiking Q-networks On The Spinnaker2 Neuromorphic Platform (2025)0.00
• Learning Fast Changing Slow In Spiking Neural Networks (2024)3.58