Did We Personalize? Assessing Personalization By An Online Reinforcement Learning Algorithm Using Resampling

Abstract

There is a growing interest in using reinforcement learning (RL) to personalize sequences of treatments in digital health to support users in adopting healthier behaviors. Such sequential decision-making problems involve decisions about when to treat and how to treat based on the user's context (e.g., prior activity level, location, etc.). Online RL is a promising data-driven approach for this problem as it learns based on each user's historical responses and uses that knowledge to personalize these decisions. However, to decide whether the RL algorithm should be included in an ``optimized'' intervention for real-world deployment, we must assess the data evidence indicating that the RL algorithm is actually personalizing the treatments to its users. Due to the stochasticity in the RL algorithm, one may get a false impression that it is learning in certain states and using this learning to provide specific treatments. We use a working definition of personalization and introduce a resamp

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyghosh2023did

Related papers

• Effective Warm Start For The Online Actor-critic Reinforcement Learning Based Mhealth Intervention (2017)0.00
• Reinforcement Learning In Dynamic Treatment Regimes Needs Critical Reexamination (2024)2.35
• Federated Offline Reinforcement Learning (2022)0.00
• Reinforcement Learning Enhanced Online Adaptive Clinical Decision Support Via Digital Twin Powered Policy And Treatment Effect Optimized Reward (2025)0.00
• Towards Optimizing Human-centric Objectives In Ai-assisted Decision-making With Offline Reinforcement Learning (2024)0.00
• Deep Reinforcement Learning For Clinical Decision Support: A Brief Survey (2019)0.00
• Offline Reinforcement Learning With Differential Privacy (2022)0.00
• An Empirical Study Of Representation Learning For Reinforcement Learning In Healthcare (2020)0.00