Real-time Model Calibration With Deep Reinforcement Learning

Abstract

The dynamic, real-time, and accurate inference of model parameters from empirical data is of great importance in many scientific and engineering disciplines that use computational models (such as a digital twin) for the analysis and prediction of complex physical processes. However, fast and accurate inference for processes with large and high dimensional datasets cannot easily be achieved with state-of-the-art methods under noisy real-world conditions. The primary reason is that the inference of model parameters with traditional techniques based on optimisation or sampling often suffers from computational and statistical challenges, resulting in a trade-off between accuracy and deployment time. In this paper, we propose a novel framework for inference of model parameters based on reinforcement learning. The contribution of the paper is twofold: 1) We reformulate the inference problem as a tracking problem with the objective of learning a policy that forces the response of the physics-

Stats

• citations67
• S2 citations—
• github stars0
• HF likes0
• heat score13.74
• arxiv keytian2020real

Related papers

• Deep Reinforcement Learning In A Handful Of Trials Using Probabilistic Dynamics Models (2018)0.00
• Hierarchical Framework For Interpretable And Probabilistic Model-based Safe Reinforcement Learning (2023)0.00
• Model-based Reinforcement Learning For Control Under Time-varying Dynamics (2026)0.00
• MM-KTD: Multiple Model Kalman Temporal Differences For Reinforcement Learning (2020)0.00
• Explicitly Encouraging Low Fractional Dimensional Trajectories Via Reinforcement Learning (2020)0.00
• Multi-fidelity Reinforcement Learning Control For Complex Dynamical Systems (2025)0.00
• Hyperl: Hypernetwork-based Reinforcement Learning For Control Of Parametrized Dynamical Systems (2025)0.00
• Actively Learning Reinforcement Learning: A Stochastic Optimal Control Approach (2023)0.00