A Definition Of Continual Reinforcement Learning

Abstract

In a standard view of the reinforcement learning problem, an agent's goal is to efficiently identify a policy that maximizes long-term reward. However, this perspective is based on a restricted view of learning as finding a solution, rather than treating learning as endless adaptation. In contrast, continual reinforcement learning refers to the setting in which the best agents never stop learning. Despite the importance of continual reinforcement learning, the community lacks a simple definition of the problem that highlights its commitments and makes its primary concepts precise and clear. To this end, this paper is dedicated to carefully defining the continual reinforcement learning problem. We formalize the notion of agents that "never stop learning" through a new mathematical language for analyzing and cataloging agents. Using this new language, we define a continual learning agent as one that can be understood as carrying out an implicit search process indefinitely, and continual

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keyabel2023a

Related papers

• Rethinking The Foundations For Continual Reinforcement Learning (2025)0.00
• Towards Continual Reinforcement Learning: A Review And Perspectives (2020)0.00
• Advancements And Challenges In Continual Reinforcement Learning: A Comprehensive Review (2025)0.00
• Continual Learning As Computationally Constrained Reinforcement Learning (2023)0.00
• A Survey Of Continual Reinforcement Learning (2025)0.00
• Continual World: A Robotic Benchmark For Continual Reinforcement Learning (2021)0.00
• Ergodic Risk Measures: Towards A Risk-aware Foundation For Continual Reinforcement Learning (2025)0.00
• Position: Lifetime Tuning Is Incompatible With Continual Reinforcement Learning (2024)0.00