Policy Learning With Adaptively Collected Data

Abstract

Learning optimal policies from historical data enables personalization in a wide variety of applications including healthcare, digital recommendations, and online education. The growing policy learning literature focuses on settings where the data collection rule stays fixed throughout the experiment. However, adaptive data collection is becoming more common in practice, from two primary sources: 1) data collected from adaptive experiments that are designed to improve inferential efficiency; 2) data collected from production systems that progressively evolve an operational policy to improve performance over time (e.g. contextual bandits). Yet adaptivity complicates the optimal policy identification ex post, since samples are dependent, and each treatment may not receive enough observations for each type of individual. In this paper, we make initial research inquiries into addressing the challenges of learning the optimal policy with adaptively collected data. We propose an algorithm ba

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhan2021policy

Related papers

• Logarithmic Smoothing For Adaptive Pac-bayesian Off-policy Learning (2025)0.00
• Adaptive Experimental Design For Policy Learning (2024)0.00
• Importance Weighted Policy Learning And Adaptation (2020)0.00
• Adapting Behaviour For Learning Progress (2019)0.00
• Live In The Moment: Learning Dynamics Model Adapted To Evolving Policy (2022)0.00
• Online Adaptation For Enhancing Imitation Learning Policies (2024)0.00
• Policy Learning "without" Overlap: Pessimism And Generalized Empirical Bernstein's Inequality (2022)0.00
• Learning A Subspace Of Policies For Online Adaptation In Reinforcement Learning (2021)0.00