Lifelong Reinforcement Learning With Modulating Masks

Abstract

Lifelong learning aims to create AI systems that continuously and incrementally learn during a lifetime, similar to biological learning. Attempts so far have met problems, including catastrophic forgetting, interference among tasks, and the inability to exploit previous knowledge. While considerable research has focused on learning multiple supervised classification tasks that involve changes in the input distribution, lifelong reinforcement learning (LRL) must deal with variations in the state and transition distributions, and in the reward functions. Modulating masks with a fixed backbone network, recently developed for classification, are particularly suitable to deal with such a large spectrum of task variations. In this paper, we adapted modulating masks to work with deep LRL, specifically PPO and IMPALA agents. The comparison with LRL baselines in both discrete and continuous RL tasks shows superior performance. We further investigated the use of a linear combination of previousl

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybeniwhiwhu2022lifelong

Related papers

• Sharing Lifelong Reinforcement Learning Knowledge Via Modulating Masks (2023)0.00
• Continuous Coordination As A Realistic Scenario For Lifelong Learning (2021)0.00
• CAMEL: Continuous Action Masking Enabled By Large Language Models For Reinforcement Learning (2025)0.00
• Lipschitz Lifelong Reinforcement Learning (2020)8.35
• Statistical Guarantees For Lifelong Reinforcement Learning Using Pac-bayes Theory (2024)0.00
• Lifelong Reinforcement Learning Via Neuromodulation (2024)0.00
• Excluding The Irrelevant: Focusing Reinforcement Learning Through Continuous Action Masking (2024)4.52
• Reactive Exploration To Cope With Non-stationarity In Lifelong Reinforcement Learning (2022)0.00