The Hierarchical Adaptive Forgetting Variational Filter

Abstract

A common problem in Machine Learning and statistics consists in detecting whether the current sample in a stream of data belongs to the same distribution as previous ones, is an isolated outlier or inaugurates a new distribution of data. We present a hierarchical Bayesian algorithm that aims at learning a time-specific approximate posterior distribution of the parameters describing the distribution of the data observed. We derive the update equations of the variational parameters of the approximate posterior at each time step for models from the exponential family, and show that these updates find interesting correspondents in Reinforcement Learning (RL). In this perspective, our model can be seen as a hierarchical RL algorithm that learns a posterior distribution according to a certain stability confidence that is, in turn, learned according to its own stability confidence. Finally, we show some applications of our generic model, first in a RL context, next with an adaptive Bayesian A

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymoens2018the

Related papers

• Temporal-difference Variational Continual Learning (2024)0.00
• Learning In Volatile Environments With The Bayes Factor Surprise (2019)0.00
• Variational Inference For Model-free And Model-based Reinforcement Learning (2022)0.00
• Adaptive Multi-fidelity Reinforcement Learning For Variance Reduction In Engineering Design Optimization (2025)0.00
• Dynamic Memory For Interpretable Sequential Optimisation (2022)0.00
• Efficient Learning In Non-stationary Linear Markov Decision Processes (2020)6.77
• Replay Buffer With Local Forgetting For Adapting To Local Environment Changes In Deep Model-based Reinforcement Learning (2023)0.00
• Posterior Sampling With Delayed Feedback For Reinforcement Learning With Linear Function Approximation (2023)0.00