Reinforcement Learning In System Identification

Abstract

System identification, also known as learning forward models, transfer functions, system dynamics, etc., has a long tradition both in science and engineering in different fields. Particularly, it is a recurring theme in Reinforcement Learning research, where forward models approximate the state transition function of a Markov Decision Process by learning a mapping function from current state and action to the next state. This problem is commonly defined as a Supervised Learning problem in a direct way. This common approach faces several difficulties due to the inherent complexities of the dynamics to learn, for example, delayed effects, high non-linearity, non-stationarity, partial observability and, more important, error accumulation when using bootstrapped predictions (predictions based on past predictions), over large time horizons. Here we explore the use of Reinforcement Learning in this problem. We elaborate on why and how this problem fits naturally and sound as a Reinforcement

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keyh2022reinforcement

Related papers

• Optimal Exploration For Model-based RL In Nonlinear Systems (2023)0.00
• Demystifying Reinforcement Learning In Time-varying Systems (2022)0.00
• Reinforcement Learning And Inverse Reinforcement Learning With System 1 And System 2 (2018)7.16
• Inverse Reinforcement Learning With Simultaneous Estimation Of Rewards And Dynamics (2016)0.00
• Learning Multimodal Transition Dynamics For Model-based Reinforcement Learning (2017)0.00
• Model-based Reinforcement Learning For Control Under Time-varying Dynamics (2026)0.00
• Learning Sparse Representations In Reinforcement Learning (2019)0.00
• Meta-reinforcement Learning Robust To Distributional Shift Via Model Identification And Experience Relabeling (2020)0.00