Robust Bayesian Optimization With Reinforcement Learned Acquisition Functions
2022 · Zijing Liu, Xiyao Qu, Xuejun Liu, et al.
Abstract
In Bayesian optimization (BO) for expensive black-box optimization tasks, acquisition function (AF) guides sequential sampling and plays a pivotal role for efficient convergence to better optima. Prevailing AFs usually rely on artificial experiences in terms of preferences for exploration or exploitation, which runs a risk of a computational waste or traps in local optima and resultant re-optimization. To address the crux, the idea of data-driven AF selection is proposed, and the sequential AF selection task is further formalized as a Markov decision process (MDP) and resort to powerful reinforcement learning (RL) technologies. Appropriate selection policy for AFs is learned from superior BO trajectories to balance between exploration and exploitation in real time, which is called reinforcement-learning-assisted Bayesian optimization (RLABO). Competitive and robust BO evaluations on five benchmark problems demonstrate RL's recognition of the implicit AF selection pattern and imply the
Authors
(none)
Tags
Stats
Related papers
- Robust Model-free Reinforcement Learning With Multi-objective Bayesian Optimization (2019)11.08
- Enhancing Offline Model-based RL Via Active Model Selection: A Bayesian Optimization Perspective (2025)0.00
- Bayesian Residual Policy Optimization: Scalable Bayesian Reinforcement Learning With Clairvoyant Experts (2020)0.00
- Alternating Optimisation And Quadrature For Robust Control (2016)7.16
- MUSBO: Model-based Uncertainty Regularized And Sample Efficient Batch Optimization For Deployment Constrained Reinforcement Learning (2021)0.00
- Automatic Tuning Of Hyper-parameters Of Reinforcement Learning Algorithms Using Bayesian Optimization With Behavioral Cloning (2021)0.00
- Multi-objective Reward And Preference Optimization: Theory And Algorithms (2025)0.00
- Bootstrap Advantage Estimation For Policy Optimization In Reinforcement Learning (2022)0.00