Joint Modeling For Learning Decision-making Dynamics In Behavioral Experiments

Abstract

Major depressive disorder (MDD), a leading cause of disability and mortality, is associated with reward-processing abnormalities and concentration issues. Motivated by the probabilistic reward task from the Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care (EMBARC) study, we propose a novel framework that integrates the reinforcement learning (RL) model and drift-diffusion model (DDM) to jointly analyze reward-based decision-making with response times. To account for emerging evidence suggesting that decision-making may alternate between multiple interleaved strategies, we model latent state switching using a hidden Markov model (HMM). In the ''engaged'' state, decisions follow an RL-DDM, simultaneously capturing reward processing, decision dynamics, and temporal structure. In contrast, in the ''lapsed'' state, decision-making is modeled using a simplified DDM, where specific parameters are fixed to approximate random guessing with equal probability.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybian2025joint

Related papers

• HMM For Discovering Decision-making Dynamics Using Reinforcement Learning Experiments (2024)0.00
• Unified Models Of Human Behavioral Agents In Bandits, Contextual Bandits And RL (2020)8.35
• Understanding Individual Decision-making In Multi-agent Reinforcement Learning: A Dynamical Systems Approach (2025)0.00
• Reinforcement Learning With Human Feedback: Learning Dynamic Choices Via Pessimism (2023)0.00
• A Story Of Two Streams: Reinforcement Learning Models From Human Behavior And Neuropsychiatry (2019)0.00
• Efficient Inference For Inverse Reinforcement Learning And Dynamic Discrete Choice Models (2025)0.00
• Linear Mixture Distributionally Robust Markov Decision Processes (2025)0.00
• Asymptotically Optimal Reinforcement Learning In Block Markov Decision Processes (2025)0.00