Inverse Decision Modeling: Learning Interpretable Representations Of Behavior

Abstract

Decision analysis deals with modeling and enhancing decision processes. A principal challenge in improving behavior is in obtaining a transparent description of existing behavior in the first place. In this paper, we develop an expressive, unifying perspective on inverse decision modeling: a framework for learning parameterized representations of sequential decision behavior. First, we formalize the forward problem (as a normative standard), subsuming common classes of control behavior. Second, we use this to formalize the inverse problem (as a descriptive model), generalizing existing work on imitation/reward learning -- while opening up a much broader class of research problems in behavior representation. Finally, we instantiate this approach with an example (inverse bounded rational control), illustrating how this structure enables learning (interpretable) representations of (bounded) rationality -- while naturally capturing intuitive notions of suboptimal actions, biased beliefs, a

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyjarrett2023inverse

Related papers

• Learning "what-if" Explanations For Sequential Decision-making (2020)0.00
• Efficient Inference For Inverse Reinforcement Learning And Dynamic Discrete Choice Models (2025)0.00
• Where Do You Think You're Going?: Inferring Beliefs About Dynamics From Behavior (2018)0.00
• Modeling And Interpreting Real-world Human Risk Decision Making With Inverse Reinforcement Learning (2019)0.00
• Probabilistic Inverse Optimal Control For Non-linear Partially Observable Systems Disentangles Perceptual Uncertainty And Behavioral Costs (2023)0.00
• Multi-intention Inverse Q-learning For Interpretable Behavior Representation (2023)0.00
• Reinforcement Learning And Inverse Reinforcement Learning With System 1 And System 2 (2018)7.16
• Modeling Human Behavior Part I -- Learning And Belief Approaches (2022)0.00