Fast Physical Activity Suggestions: Efficient Hyperparameter Learning In Mobile Health

Abstract

Users can be supported to adopt healthy behaviors, such as regular physical activity, via relevant and timely suggestions on their mobile devices. Recently, reinforcement learning algorithms have been found to be effective for learning the optimal context under which to provide suggestions. However, these algorithms are not necessarily designed for the constraints posed by mobile health (mHealth) settings, that they be efficient, domain-informed and computationally affordable. We propose an algorithm for providing physical activity suggestions in mHealth settings. Using domain-science, we formulate a contextual bandit algorithm which makes use of a linear mixed effects model. We then introduce a procedure to efficiently perform hyper-parameter updating, using far less computational resources than competing approaches. Not only is our approach computationally efficient, it is also easily implemented with closed form matrix algebraic updates and we show improvements over state of the art

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymenictas2020fast

Related papers

• Optimizing Algorithms For Mobile Health Interventions With Active Querying Optimization (2025)0.00
• Cohesion-based Online Actor-critic Reinforcement Learning For Mhealth Intervention (2017)5.24
• Effective Warm Start For The Online Actor-critic Reinforcement Learning Based Mhealth Intervention (2017)0.00
• IRL For Restless Multi-armed Bandits With Applications In Maternal And Child Health (2024)0.00
• Data Efficient Training For Reinforcement Learning With Adaptive Behavior Policy Sharing (2020)0.00
• Generalized Population-based Training For Hyperparameter Optimization In Reinforcement Learning (2024)9.59
• Did We Personalize? Assessing Personalization By An Online Reinforcement Learning Algorithm Using Resampling (2023)4.52
• Policy Learning With Adaptively Collected Data (2021)0.00