Inverse Rational Control: Inferring What You Think From How You Forage

Abstract

Complex behaviors are often driven by an internal model, which integrates sensory information over time and facilitates long-term planning. Inferring an agent's internal model is a crucial ingredient in social interactions (theory of mind), for imitation learning, and for interpreting neural activities of behaving agents. Here we describe a generic method to model an agent's behavior under an environment with uncertainty, and infer the agent's internal model, reward function, and dynamic beliefs. We apply our method to a simulated agent performing a naturalistic foraging task. We assume the agent behaves rationally --- that is, they take actions that optimize their subjective utility according to their understanding of the task and its relevant causal variables. We model this rational solution as a Partially Observable Markov Decision Process (POMDP) where the agent may make wrong assumptions about the task parameters. Given the agent's sensory observations and actions, we learn its in

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywu2018inverse

Related papers

• Inverse Rational Control With Partially Observable Continuous Nonlinear Dynamics (2019)0.00
• Goal-oriented Inference Of Environment From Redundant Observations (2023)3.58
• Where Do You Think You're Going?: Inferring Beliefs About Dynamics From Behavior (2018)0.00
• Active Inference As A Model Of Agency (2024)0.00
• Combining Imitation And Deep Reinforcement Learning To Accomplish Human-level Performance On A Virtual Foraging Task (2022)0.00
• Implications Of Human Irrationality For Reinforcement Learning (2020)0.00
• Information Is Power: Intrinsic Control Via Information Capture (2021)0.00
• Reasoning About Unforeseen Possibilities During Policy Learning (2018)0.00