Advancing Continual Lifelong Learning In Neural Information Retrieval: Definition, Dataset, Framework, And Empirical Evaluation

Abstract

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning methods for information retrieval tasks, a well-defined task formulation is still lacking, and it is unclear how typical learning strategies perform in this context. To address this challenge, a systematic task formulation of continual neural information retrieval is presented, along with a multiple-topic dataset that simulates continuous information retrieval. A comprehensive continual neural information retrieval framework consisting of typical retrieval models and continual learning strategies is then proposed. Empirical evaluations illustrate that the proposed framework can successfully prevent catastrophic forgetting in neural information retrieval and enhance performance on previously learned tasks. The results indicate that embedding-based retr

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keyhou2023advancing

Related papers

• Continual Learning In Cross-modal Retrieval (2021)9.41
• L^2R: Lifelong Learning For First-stage Retrieval With Backward-compatible Representations (2023)5.24
• Neural Information Retrieval: A Literature Review (2016)0.00
• Continual Learning For Generative Retrieval Over Dynamic Corpora (2023)11.49
• Retrieval-enhanced Machine Learning (2022)11.93
• Neural Models For Information Retrieval (2017)0.00
• CREAM: Continual Retrieval On Dynamic Streaming Corpora With Adaptive Soft Memory (2026)0.00
• Query Drift Compensation: Enabling Compatibility In Continual Learning Of Retrieval Embedding Models (2025)1.20