Towards A Simple Approach To Multi-step Model-based Reinforcement Learning

Abstract

When environmental interaction is expensive, model-based reinforcement learning offers a solution by planning ahead and avoiding costly mistakes. Model-based agents typically learn a single-step transition model. In this paper, we propose a multi-step model that predicts the outcome of an action sequence with variable length. We show that this model is easy to learn, and that the model can make policy-conditional predictions. We report preliminary results that show a clear advantage for the multi-step model compared to its one-step counterpart.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyasadi2018towards

Related papers

• Models As Agents: Optimizing Multi-step Predictions Of Interactive Local Models In Model-based Multi-agent Reinforcement Learning (2023)6.77
• A Model-based Approach For Sample-efficient Multi-task Reinforcement Learning (2019)0.00
• Efficient Model-based Multi-agent Reinforcement Learning Via Optimistic Equilibrium Computation (2022)0.00
• Learning Multimodal Transition Dynamics For Model-based Reinforcement Learning (2017)0.00
• Mingling Foresight With Imagination: Model-based Cooperative Multi-agent Reinforcement Learning (2022)0.00
• Model-based Multi-agent Reinforcement Learning: Recent Progress And Prospects (2022)0.00
• Towards Model-based Reinforcement Learning For Industry-near Environments (2019)5.84
• Plan To Predict: Learning An Uncertainty-foreseeing Model For Model-based Reinforcement Learning (2023)0.00