Where Do You Think You're Going?: Inferring Beliefs About Dynamics From Behavior

Abstract

Inferring intent from observed behavior has been studied extensively within the frameworks of Bayesian inverse planning and inverse reinforcement learning. These methods infer a goal or reward function that best explains the actions of the observed agent, typically a human demonstrator. Another agent can use this inferred intent to predict, imitate, or assist the human user. However, a central assumption in inverse reinforcement learning is that the demonstrator is close to optimal. While models of suboptimal behavior exist, they typically assume that suboptimal actions are the result of some type of random noise or a known cognitive bias, like temporal inconsistency. In this paper, we take an alternative approach, and model suboptimal behavior as the result of internal model misspecification: the reason that user actions might deviate from near-optimal actions is that the user has an incorrect set of beliefs about the rules -- the dynamics -- governing how actions affect the environme

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyreddy2018where

Related papers

• Inverse Rational Control: Inferring What You Think From How You Forage (2018)0.00
• Inverse Decision Modeling: Learning Interpretable Representations Of Behavior (2023)0.00
• Accounting For Human Learning When Inferring Human Preferences (2020)0.00
• Modeling Human Behavior Part I -- Learning And Belief Approaches (2022)0.00
• Can You See How I Learn? Human Observers' Inferences About Reinforcement Learning Agents' Learning Processes (2025)0.00
• Reinforcement Learning And Inverse Reinforcement Learning With System 1 And System 2 (2018)7.16
• Learning Human Rewards By Inferring Their Latent Intelligence Levels In Multi-agent Games: A Theory-of-mind Approach With Application To Driving Data (2021)0.00
• Active Inference As A Model Of Agency (2024)0.00