IRL For Restless Multi-armed Bandits With Applications In Maternal And Child Health

Abstract

Public health practitioners often have the goal of monitoring patients and maximizing patients' time spent in "favorable" or healthy states while being constrained to using limited resources. Restless multi-armed bandits (RMAB) are an effective model to solve this problem as they are helpful to allocate limited resources among many agents under resource constraints, where patients behave differently depending on whether they are intervened on or not. However, RMABs assume the reward function is known. This is unrealistic in many public health settings because patients face unique challenges and it is impossible for a human to know who is most deserving of any intervention at such a large scale. To address this shortcoming, this paper is the first to present the use of inverse reinforcement learning (IRL) to learn desired rewards for RMABs, and we demonstrate improved outcomes in a maternal and child health telehealth program. First we allow public health experts to specify their goals

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyjain2024irl

Related papers

• Towards A Pretrained Model For Restless Bandits Via Multi-arm Generalization (2023)0.00
• Provably Efficient Reinforcement Learning For Adversarial Restless Multi-armed Bandits With Unknown Transitions And Bandit Feedback (2024)0.00
• Balancing Act: Prioritization Strategies For Llm-designed Restless Bandit Rewards (2024)0.00
• Q-learning Lagrange Policies For Multi-action Restless Bandits (2021)8.35
• Learning In Restless Bandits Under Exogenous Global Markov Process (2021)6.34
• Modeling And Interpreting Real-world Human Risk Decision Making With Inverse Reinforcement Learning (2019)0.00
• Optimizing Algorithms For Mobile Health Interventions With Active Querying Optimization (2025)0.00
• Unified Models Of Human Behavioral Agents In Bandits, Contextual Bandits And RL (2020)8.35