Inferential Induction: A Novel Framework For Bayesian Reinforcement Learning

Abstract

Bayesian reinforcement learning (BRL) offers a decision-theoretic solution for reinforcement learning. While "model-based" BRL algorithms have focused either on maintaining a posterior distribution on models or value functions and combining this with approximate dynamic programming or tree search, previous Bayesian "model-free" value function distribution approaches implicitly make strong assumptions or approximations. We describe a novel Bayesian framework, Inferential Induction, for correctly inferring value function distributions from data, which leads to the development of a new class of BRL algorithms. We design an algorithm, Bayesian Backwards Induction, with this framework. We experimentally demonstrate that the proposed algorithm is competitive with respect to the state of the art.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyeriksson2020inferential

Related papers

• Generalized Bayesian Deep Reinforcement Learning (2024)0.00
• Combining Bayesian Inference And Reinforcement Learning For Agent Decision Making: A Review (2025)0.00
• Bayesian Exploration Networks (2023)0.00
• A Bayesian Approach To Robust Inverse Reinforcement Learning (2023)0.00
• Online Bayesian Risk-averse Reinforcement Learning (2025)0.00
• Efficient Inference For Inverse Reinforcement Learning And Dynamic Discrete Choice Models (2025)0.00
• Bayesian Reparameterization Of Reward-conditioned Reinforcement Learning With Energy-based Models (2023)0.00
• Prior Preference Learning From Experts:designing A Reward With Active Inference (2021)0.00