Multi-task Learning And Catastrophic Forgetting In Continual Reinforcement Learning

Abstract

In this paper we investigate two hypothesis regarding the use of deep reinforcement learning in multiple tasks. The first hypothesis is driven by the question of whether a deep reinforcement learning algorithm, trained on two similar tasks, is able to outperform two single-task, individually trained algorithms, by more efficiently learning a new, similar task, that none of the three algorithms has encountered before. The second hypothesis is driven by the question of whether the same multi-task deep RL algorithm, trained on two similar tasks and augmented with elastic weight consolidation (EWC), is able to retain similar performance on the new task, as a similar algorithm without EWC, whilst being able to overcome catastrophic forgetting in the two previous tasks. We show that a multi-task Asynchronous Advantage Actor-Critic (GA3C) algorithm, trained on Space Invaders and Demon Attack, is in fact able to outperform two single-tasks GA3C versions, trained individually for each single-ta

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyribeiro2019multi

Related papers

• Task-agnostic Continual Reinforcement Learning: Gaining Insights And Overcoming Challenges (2022)0.00
• Same State, Different Task: Continual Reinforcement Learning Without Interference (2021)0.00
• Replay-enhanced Continual Reinforcement Learning (2023)0.00
• Experience Replay For Continual Learning (2018)0.00
• Continual Knowledge Adaptation For Reinforcement Learning (2025)0.00
• Continual Policy Distillation From Distributed Reinforcement Learning Teachers (2026)0.00
• Modular Networks Prevent Catastrophic Interference In Model-based Multi-task Reinforcement Learning (2021)0.00
• Continual Reinforcement Learning With Complex Synapses (2018)0.00