Task-agnostic Continual Reinforcement Learning: Gaining Insights And Overcoming Challenges

Abstract

Continual learning (CL) enables the development of models and agents that learn from a sequence of tasks while addressing the limitations of standard deep learning approaches, such as catastrophic forgetting. In this work, we investigate the factors that contribute to the performance differences between task-agnostic CL and multi-task (MTL) agents. We pose two hypotheses: (1) task-agnostic methods might provide advantages in settings with limited data, computation, or high dimensionality, and (2) faster adaptation may be particularly beneficial in continual learning settings, helping to mitigate the effects of catastrophic forgetting. To investigate these hypotheses, we introduce a replay-based recurrent reinforcement learning (3RL) methodology for task-agnostic CL agents. We assess 3RL on a synthetic task and the Meta-World benchmark, which includes 50 unique manipulation tasks. Our results demonstrate that 3RL outperforms baseline methods and can even surpass its multi-task equivalen

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keycaccia2022task

Related papers

• Continual World: A Robotic Benchmark For Continual Reinforcement Learning (2021)0.00
• Same State, Different Task: Continual Reinforcement Learning Without Interference (2021)0.00
• Continual Policy Distillation From Distributed Reinforcement Learning Teachers (2026)0.00
• Multi-task Learning And Catastrophic Forgetting In Continual Reinforcement Learning (2019)0.00
• A Survey Of Continual Reinforcement Learning (2025)0.00
• Advancements And Challenges In Continual Reinforcement Learning: A Comprehensive Review (2025)0.00
• Continual Knowledge Adaptation For Reinforcement Learning (2025)0.00
• Multi-granularity Knowledge Transfer For Continual Reinforcement Learning (2024)2.26