Hypercontroller: A Hyperparameter Controller For Fast And Stable Training Of Reinforcement Learning Neural Networks

Abstract

We introduce Hyperparameter Controller (HyperController), a computationally efficient algorithm for hyperparameter optimization during training of reinforcement learning neural networks. HyperController optimizes hyperparameters quickly while also maintaining improvement of the reinforcement learning neural network, resulting in faster training and deployment. It achieves this by modeling the hyperparameter optimization problem as an unknown Linear Gaussian Dynamical System, which is a system with a state that linearly changes. It then learns an efficient representation of the hyperparameter objective function using the Kalman filter, which is the optimal one-step predictor for a Linear Gaussian Dynamical System. To demonstrate the performance of HyperController, it is applied as a hyperparameter optimizer during training of reinforcement learning neural networks on a variety of OpenAI Gymnasium environments. In four out of the five Gymnasium environments, HyperController achieves high

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keygornet2025hypercontroller

Related papers

• Hyperl: Hypernetwork-based Reinforcement Learning For Control Of Parametrized Dynamical Systems (2025)0.00
• Hyperparameter Tuning For Deep Reinforcement Learning Applications (2022)0.00
• Generalized Population-based Training For Hyperparameter Optimization In Reinforcement Learning (2024)9.59
• A Framework For History-aware Hyperparameter Optimisation In Reinforcement Learning (2023)0.00
• Hyperparameter Optimisation With Practical Interpretability And Explanation Methods In Probabilistic Curriculum Learning (2025)0.00
• RLOC: Neurobiologically Inspired Hierarchical Reinforcement Learning Algorithm For Continuous Control Of Nonlinear Dynamical Systems (2019)0.00
• Automatic Tuning Of Hyper-parameters Of Reinforcement Learning Algorithms Using Bayesian Optimization With Behavioral Cloning (2021)0.00
• A Hierarchical Two-tier Approach To Hyper-parameter Optimization In Reinforcement Learning (2019)0.00