A Framework For History-aware Hyperparameter Optimisation In Reinforcement Learning

Abstract

A Reinforcement Learning (RL) system depends on a set of initial conditions (hyperparameters) that affect the system's performance. However, defining a good choice of hyperparameters is a challenging problem. Hyperparameter tuning often requires manual or automated searches to find optimal values. Nonetheless, a noticeable limitation is the high cost of algorithm evaluation for complex models, making the tuning process computationally expensive and time-consuming. In this paper, we propose a framework based on integrating complex event processing and temporal models, to alleviate these trade-offs. Through this combination, it is possible to gain insights about a running RL system efficiently and unobtrusively based on data stream monitoring and to create abstract representations that allow reasoning about the historical behaviour of the RL system. The obtained knowledge is exploited to provide feedback to the RL system for optimising its hyperparameters while making effective use o

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyparraullauri2023a

Related papers

• Hyperparameter Tuning For Deep Reinforcement Learning Applications (2022)0.00
• On Hyper-parameter Tuning For Stochastic Optimization Algorithms (2020)0.00
• Automatic Tuning Of Hyper-parameters Of Reinforcement Learning Algorithms Using Bayesian Optimization With Behavioral Cloning (2021)0.00
• A Hierarchical Two-tier Approach To Hyper-parameter Optimization In Reinforcement Learning (2019)0.00
• Generalized Population-based Training For Hyperparameter Optimization In Reinforcement Learning (2024)9.59
• Sample-efficient Automated Deep Reinforcement Learning (2020)0.00
• Hyperl: Hypernetwork-based Reinforcement Learning For Control Of Parametrized Dynamical Systems (2025)0.00
• Hyperparameter Optimisation With Practical Interpretability And Explanation Methods In Probabilistic Curriculum Learning (2025)0.00