Learning To Influence Human Behavior With Offline Reinforcement Learning

Abstract

When interacting with people, AI agents do not just influence the state of the world -- they also influence the actions people take in response to the agent, and even their underlying intentions and strategies. Accounting for and leveraging this influence has mostly been studied in settings where it is sufficient to assume that human behavior is near-optimal: competitive games, or general-sum settings like autonomous driving alongside human drivers. Instead, we focus on influence in settings where there is a need to capture human suboptimality. For instance, imagine a collaborative task in which, due either to cognitive biases or lack of information, people do not perform very well -- how could an agent influence them towards more optimal behavior? Assuming near-optimal human behavior will not work here, and so the agent needs to learn from real human data. But experimenting online with humans is potentially unsafe, and creating a high-fidelity simulator of the environment is often imp

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhong2023learning

Related papers

• Towards Optimizing Human-centric Objectives In Ai-assisted Decision-making With Offline Reinforcement Learning (2024)0.00
• Optimality Inductive Biases And Agnostic Guidelines For Offline Reinforcement Learning (2021)0.00
• Improving Multimodal Interactive Agents With Reinforcement Learning From Human Feedback (2022)0.00
• Reward Shaping For Human Learning Via Inverse Reinforcement Learning (2020)0.00
• Towards Data-driven Offline Simulations For Online Reinforcement Learning (2022)0.00
• Online Learning In Iterated Prisoner's Dilemma To Mimic Human Behavior (2020)0.00
• Learning Latent Representations To Influence Multi-agent Interaction (2020)0.00
• AWAC: Accelerating Online Reinforcement Learning With Offline Datasets (2020)0.00