Sample-efficient Reinforcement Learning Controller For Deep Brain Stimulation In Parkinson's Disease

Abstract

Deep brain stimulation (DBS) is an established intervention for Parkinson's disease (PD), but conventional open-loop systems lack adaptability, are energy-inefficient due to continuous stimulation, and provide limited personalization to individual neural dynamics. Adaptive DBS (aDBS) offers a closed-loop alternative, using biomarkers such as beta-band oscillations to dynamically modulate stimulation. While reinforcement learning (RL) holds promise for personalized aDBS control, existing methods suffer from high sample complexity, unstable exploration in binary action spaces, and limited deployability on resource-constrained hardware. We propose SEA-DBS, a sample-efficient actor-critic framework that addresses the core challenges of RL-based adaptive neurostimulation. SEA-DBS integrates a predictive reward model to reduce reliance on real-time feedback and employs Gumbel Softmax-based exploration for stable, differentiable policy updates in binary action spaces. Together, these compon

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyravivarapu2025sample

Related papers

• Novel Reinforcement Learning Algorithm For Suppressing Synchronization In Closed Loop Deep Brain Stimulators (2022)2.26
• Coprocessor Actor Critic: A Model-based Reinforcement Learning Approach For Adaptive Brain Stimulation (2024)0.00
• Reinforcement Learning Framework For Deep Brain Stimulation Study (2020)7.50
• Broad Critic Deep Actor Reinforcement Learning For Continuous Control (2024)0.00
• An Improved Strategy For Blood Glucose Control Using Multi-step Deep Reinforcement Learning (2024)5.84
• Decoupled Exploration And Exploitation Policies For Sample-efficient Reinforcement Learning (2021)0.00
• Deep Exploration With Pac-bayes (2024)0.00
• PDRL: Multi-agent Based Reinforcement Learning For Predictive Monitoring (2023)0.00