Task-agnostic Online Reinforcement Learning With An Infinite Mixture Of Gaussian Processes

Abstract

Continuously learning to solve unseen tasks with limited experience has been extensively pursued in meta-learning and continual learning, but with restricted assumptions such as accessible task distributions, independently and identically distributed tasks, and clear task delineations. However, real-world physical tasks frequently violate these assumptions, resulting in performance degradation. This paper proposes a continual online model-based reinforcement learning approach that does not require pre-training to solve task-agnostic problems with unknown task boundaries. We maintain a mixture of experts to handle nonstationarity, and represent each different type of dynamics with a Gaussian Process to efficiently leverage collected data and expressively model uncertainty. We propose a transition prior to account for the temporal dependencies in streaming data and update the mixture online via sequential variational inference. Our approach reliably handles the task distribution shift by

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyxu2020task

Related papers

• Meta Reinforcement Learning With Latent Variable Gaussian Processes (2018)0.00
• Online Reinforcement Learning Via Sparse Gaussian Mixture Model Q-functions (2025)0.00
• Fast Reinforcement Learning With Incremental Gaussian Mixture Models (2020)0.00
• Distributionally Robust Model-based Reinforcement Learning With Large State Spaces (2023)0.00
• Continual Offline Reinforcement Learning Via Diffusion-based Dual Generative Replay (2024)0.00
• Decoupling Meta-reinforcement Learning With Gaussian Task Contexts And Skills (2023)2.26
• Autoregressive Policies For Continuous Control Deep Reinforcement Learning (2019)7.50
• Deep Online Learning Via Meta-learning: Continual Adaptation For Model-based RL (2018)0.00