Beyond Supervised Continual Learning: A Review

Abstract

Continual Learning (CL, sometimes also termed incremental learning) is a flavor of machine learning where the usual assumption of stationary data distribution is relaxed or omitted. When naively applying, e.g., DNNs in CL problems, changes in the data distribution can cause the so-called catastrophic forgetting (CF) effect: an abrupt loss of previous knowledge. Although many significant contributions to enabling CL have been made in recent years, most works address supervised (classification) problems. This article reviews literature that study CL in other settings, such as learning with reduced supervision, fully unsupervised learning, and reinforcement learning. Besides proposing a simple schema for classifying CL approaches w.r.t. their level of autonomy and supervision, we discuss the specific challenges associated with each setting and the potential contributions to the field of CL in general.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybagus2022beyond

Related papers

• Towards Continual Reinforcement Learning: A Review And Perspectives (2020)0.00
• A Survey Of Continual Reinforcement Learning (2025)0.00
• Advancements And Challenges In Continual Reinforcement Learning: A Comprehensive Review (2025)0.00
• Sequoia: A Software Framework To Unify Continual Learning Research (2021)0.00
• Task-agnostic Continual Reinforcement Learning: Gaining Insights And Overcoming Challenges (2022)0.00
• Continual World: A Robotic Benchmark For Continual Reinforcement Learning (2021)0.00
• Temporal-difference Variational Continual Learning (2024)0.00
• Continual Learning As Computationally Constrained Reinforcement Learning (2023)0.00