Explicitly Encouraging Low Fractional Dimensional Trajectories Via Reinforcement Learning

Abstract

A key limitation in using various modern methods of machine learning in developing feedback control policies is the lack of appropriate methodologies to analyze their long-term dynamics, in terms of making any sort of guarantees (even statistically) about robustness. The central reasons for this are largely due to the so-called curse of dimensionality, combined with the black-box nature of the resulting control policies themselves. This paper aims at the first of these issues. Although the full state space of a system may be quite large in dimensionality, it is a common feature of most model-based control methods that the resulting closed-loop systems demonstrate dominant dynamics that are rapidly driven to some lower-dimensional sub-space within. In this work we argue that the dimensionality of this subspace is captured by tools from fractal geometry, namely various notions of a fractional dimension. We then show that the dimensionality of trajectories induced by model free reinforcem

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keygillen2020explicitly

Related papers

• Reinforcement Learning With Trajectory Feedback (2020)0.00
• Sample Complexity Of Estimating The Policy Gradient For Nearly Deterministic Dynamical Systems (2019)0.00
• Multi-fidelity Reinforcement Learning Control For Complex Dynamical Systems (2025)0.00
• On The Geometry Of Reinforcement Learning In Continuous State And Action Spaces (2022)0.00
• Model-based Reinforcement Learning For Control Under Time-varying Dynamics (2026)0.00
• Optimal Exploration For Model-based RL In Nonlinear Systems (2023)0.00
• Logarithmic Regret For Nonlinear Control (2025)0.00
• Actively Learning Reinforcement Learning: A Stochastic Optimal Control Approach (2023)0.00