Data-assimilated Model-informed Reinforcement Learning

Abstract

The control of spatio-temporally chaos is challenging because of high dimensionality and unpredictability. Model-free reinforcement learning (RL) discovers optimal control policies by interacting with the system, typically requiring observations of the full physical state. In practice, sensors often provide only partial and noisy measurements (observations) of the system. The objective of this paper is to develop a framework that enables the control of chaotic systems with partial and noisy observability. The proposed method, data-assimilated model-informed reinforcement learning (DA-MIRL), integrates (i) low-order models to approximate high-dimensional dynamics; (ii) sequential data assimilation to correct the model prediction when observations become available; and (iii) an off-policy actor-critic RL algorithm to adaptively learn an optimal control strategy based on the corrected state estimates. We test DA-MIRL on the spatiotemporally chaotic solutions of the Kuramoto-Sivashinsky eq

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyozan2025data

Related papers

• Reinforcement Learning Based Data Assimilation For Unknown State Model (2025)0.00
• Multi-fidelity Reinforcement Learning Control For Complex Dynamical Systems (2025)0.00
• Demystifying Reinforcement Learning In Time-varying Systems (2022)0.00
• Reinforcement Learning Under Partial Observability Guided By Learned Environment Models (2022)6.34
• Dynamic Reinforcement Learning For Actors (2025)0.00
• Reinforcement Learning With Partial Parametric Model Knowledge (2023)0.00
• Temporal Difference Models: Model-free Deep RL For Model-based Control (2018)0.00
• Inverse Reinforcement Learning With Simultaneous Estimation Of Rewards And Dynamics (2016)0.00