World Models As Reference Trajectories For Rapid Motor Adaptation

Abstract

Deploying learned control policies in real-world environments poses a fundamental challenge. When system dynamics change unexpectedly, performance degrades until models are retrained on new data. We introduce Reflexive World Models (RWM), a dual control framework that uses world model predictions as implicit reference trajectories for rapid adaptation. Our method separates the control problem into long-term reward maximization through reinforcement learning and robust motor execution through rapid latent control. This dual architecture achieves significantly faster adaptation with low online computational cost compared to model-based RL baselines, while maintaining near-optimal performance. The approach combines the benefits of flexible policy learning through reinforcement learning with rapid error correction capabilities, providing a principled approach to maintaining performance in high-dimensional continuous control tasks under varying dynamics.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybrito2025world

Related papers

• PWM: Policy Learning With Multi-task World Models (2024)0.00
• Imagine-2-drive: Leveraging High-fidelity World Models Via Multi-modal Diffusion Policies (2024)0.00
• Continual Visual Reinforcement Learning With A Life-long World Model (2023)2.26
• Policy-driven World Model Adaptation For Robust Offline Model-based Reinforcement Learning (2025)0.00
• Diwa: Diffusion Policy Adaptation With World Models (2025)0.00
• Learning Robust And Adaptive Real-world Continuous Control Using Simulation And Transfer Learning (2018)0.00
• Recurrent World Models Facilitate Policy Evolution (2018)0.00
• World Models Via Policy-guided Trajectory Diffusion (2023)0.00