Model Predictive Control With Self-supervised Representation Learning

Abstract

Over the last few years, we have not seen any major developments in model-free or model-based learning methods that would make one obsolete relative to the other. In most cases, the used technique is heavily dependent on the use case scenario or other attributes, e.g. the environment. Both approaches have their own advantages, for example, sample efficiency or computational efficiency. However, when combining the two, the advantages of each can be combined and hence achieve better performance. The TD-MPC framework is an example of this approach. On the one hand, a world model in combination with model predictive control is used to get a good initial estimate of the value function. On the other hand, a Q function is used to provide a good long-term estimate. Similar to algorithms like MuZero a latent state representation is used, where only task-relevant information is encoded to reduce the complexity. In this paper, we propose the use of a reconstruction function within the TD-MPC fram

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymatthies2023model

Related papers

• Blending MPC & Value Function Approximation For Efficient Reinforcement Learning (2020)0.00
• TD-MPC2: Scalable, Robust World Models For Continuous Control (2023)0.00
• Model Predictive Control And Reinforcement Learning: A Unified Framework Based On Dynamic Programming (2024)10.61
• M\(^3\)PC: Test-time Model Predictive Control For Pretrained Masked Trajectory Model (2024)0.00
• Understanding Self-predictive Learning For Reinforcement Learning (2022)0.00
• Information Theoretic Model Predictive Q-learning (2019)0.00
• Driving Reinforcement Learning With Models (2019)0.00
• Towards Safe Learning-based Non-linear Model Predictive Control Through Recurrent Neural Network Modeling (2026)0.00