Towards Continual Reinforcement Learning: A Review And Perspectives

Abstract

In this article, we aim to provide a literature review of different formulations and approaches to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We begin by discussing our perspective on why RL is a natural fit for studying continual learning. We then provide a taxonomy of different continual RL formulations by mathematically characterizing two key properties of non-stationarity, namely, the scope and driver non-stationarity. This offers a unified view of various formulations. Next, we review and present a taxonomy of continual RL approaches. We go on to discuss evaluation of continual RL agents, providing an overview of benchmarks used in the literature and important metrics for understanding agent performance. Finally, we highlight open problems and challenges in bridging the gap between the current state of continual RL and findings in neuroscience. While still in its early days, the study of continual RL has the promise to develop better increm

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keykhetarpal2020towards

Related papers

• Advancements And Challenges In Continual Reinforcement Learning: A Comprehensive Review (2025)0.00
• A Survey Of Continual Reinforcement Learning (2025)0.00
• Rethinking The Foundations For Continual Reinforcement Learning (2025)0.00
• A Definition Of Continual Reinforcement Learning (2023)7.50
• Ergodic Risk Measures: Towards A Risk-aware Foundation For Continual Reinforcement Learning (2025)0.00
• Position: Lifetime Tuning Is Incompatible With Continual Reinforcement Learning (2024)0.00
• Beyond Supervised Continual Learning: A Review (2022)0.00
• Continual World: A Robotic Benchmark For Continual Reinforcement Learning (2021)0.00