Hyperparameter Optimisation With Practical Interpretability And Explanation Methods In Probabilistic Curriculum Learning

Abstract

Hyperparameter optimisation (HPO) is crucial for achieving strong performance in reinforcement learning (RL), as RL algorithms are inherently sensitive to hyperparameter settings. Probabilistic Curriculum Learning (PCL) is a curriculum learning strategy designed to improve RL performance by structuring the agent's learning process, yet effective hyperparameter tuning remains challenging and computationally demanding. In this paper, we provide an empirical analysis of hyperparameter interactions and their effects on the performance of a PCL algorithm within standard RL tasks, including point-maze navigation and DC motor control. Using the AlgOS framework integrated with Optuna's Tree-Structured Parzen Estimator (TPE), we present strategies to refine hyperparameter search spaces, enhancing optimisation efficiency. Additionally, we introduce a novel SHAP-based interpretability approach tailored specifically for analysing hyperparameter impacts, offering clear insights into how individual

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keysalt2025hyperparameter

Related papers

• Generalized Population-based Training For Hyperparameter Optimization In Reinforcement Learning (2024)9.59
• Hyperparameter Optimization Can Even Be Harmful In Off-policy Learning And How To Deal With It (2024)0.00
• Understanding And Improving Hyperbolic Deep Reinforcement Learning (2025)0.00
• A Method For Evaluating Hyperparameter Sensitivity In Reinforcement Learning (2024)0.00
• A Framework For History-aware Hyperparameter Optimisation In Reinforcement Learning (2023)0.00
• Arlbench: Flexible And Efficient Benchmarking For Hyperparameter Optimization In Reinforcement Learning (2024)0.00
• Automatic Tuning Of Hyper-parameters Of Reinforcement Learning Algorithms Using Bayesian Optimization With Behavioral Cloning (2021)0.00
• Hyperparameter Tuning For Deep Reinforcement Learning Applications (2022)0.00