Practical Performative Policy Learning With Strategic Agents
2024 Β· Qianyi Chen, Ying Chen, Bo Li
Abstract
This paper studies the performative policy learning problem, where agents adjust their features in response to a released policy to improve their potential outcomes, inducing an endogenous distribution shift. There has been growing interest in training machine learning models in strategic environments, including strategic classification and performative prediction. However, existing approaches often rely on restrictive parametric assumptions: micro-level utility models in strategic classification and macro-level data distribution maps in performative prediction, severely limiting scalability and generalizability. We approach this problem as a complex causal inference task, relaxing parametric assumptions on both micro-level agent behavior and macro-level data distribution. Leveraging bounded rationality, we uncover a practical low-dimensional structure in distribution shifts and construct an effective mediator in the causal path from the deployed model to the shifted data. We then prop
Authors
(none)
Tags
Stats
Related papers
- Performative Policy Gradient: Optimality In Performative Reinforcement Learning (2025)0.00
- Performative Reinforcement Learning (2022)0.00
- Performative Reinforcement Learning With Linear Markov Decision Process (2024)0.00
- Understanding Model Selection For Learning In Strategic Environments (2024)0.00
- Reasoning About Unforeseen Possibilities During Policy Learning (2018)0.00
- Policy Learning With Adaptively Collected Data (2021)0.00
- Policy-guided Diffusion (2024)0.00
- Live In The Moment: Learning Dynamics Model Adapted To Evolving Policy (2022)0.00