Learning Controllable Dynamics Through Informative Exploration

Abstract

Environments with controllable dynamics are usually understood in terms of explicit models. However, such models are not always available, but may sometimes be learned by exploring an environment. In this work, we investigate using an information measure called "predicted information gain" to determine the most informative regions of an environment to explore next. Applying methods from reinforcement learning allows good suboptimal exploring policies to be found, and leads to reliable estimates of the underlying controllable dynamics. This approach is demonstrated by comparing with several myopic exploration approaches.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyloxley2025learning

Related papers

• An Optimal Policy For Learning Controllable Dynamics By Exploration (2025)0.00
• Optimal Exploration For Model-based RL In Nonlinear Systems (2023)0.00
• Information Content Exploration (2023)0.00
• Learning Adaptive Exploration Strategies In Dynamic Environments Through Informed Policy Regularization (2020)0.00
• Task-optimal Exploration In Linear Dynamical Systems (2021)0.00
• Information Is Power: Intrinsic Control Via Information Capture (2021)0.00
• STEERING: Stein Information Directed Exploration For Model-based Reinforcement Learning (2023)0.00
• Optimistic Active Exploration Of Dynamical Systems (2023)0.00