Episodic Future Thinking Mechanism For Multi-agent Reinforcement Learning

Abstract

Understanding cognitive processes in multi-agent interactions is a primary goal in cognitive science. It can guide the direction of artificial intelligence (AI) research toward social decision-making in multi-agent systems, which includes uncertainty from character heterogeneity. In this paper, we introduce an episodic future thinking (EFT) mechanism for a reinforcement learning (RL) agent, inspired by cognitive processes observed in animals. To enable future thinking functionality, we first develop a multi-character policy that captures diverse characters with an ensemble of heterogeneous policies. Here, the character of an agent is defined as a different weight combination on reward components, representing distinct behavioral preferences. The future thinking agent collects observation-action trajectories of the target agents and uses the pre-trained multi-character policy to infer their characters. Once the character is inferred, the agent predicts the upcoming actions of target age

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylee2024episodic

Related papers

• Competitive Multi-agent Deep Reinforcement Learning With Counterfactual Thinking (2019)7.16
• Embedded Universal Predictive Intelligence: A Coherent Framework For Multi-agent Learning (2025)0.00
• Theory Of Mind As Intrinsic Motivation For Multi-agent Reinforcement Learning (2023)0.00
• Genai-based Multi-agent Reinforcement Learning Towards Distributed Agent Intelligence: A Generative-rl Agent Perspective (2025)0.00
• Probabilistic Recursive Reasoning For Multi-agent Reinforcement Learning (2019)0.00
• Predicting Future Actions Of Reinforcement Learning Agents (2024)3.58
• Mingling Foresight With Imagination: Model-based Cooperative Multi-agent Reinforcement Learning (2022)0.00
• Fact-based Agent Modeling For Multi-agent Reinforcement Learning (2023)0.00