Unsupervised Online Continual Learning For Automatic Speech Recognition

Abstract

Adapting Automatic Speech Recognition (ASR) models to new domains leads to Catastrophic Forgetting (CF) of previously learned information. This paper addresses CF in the challenging context of Online Continual Learning (OCL), with tasks presented as a continuous data stream with unknown boundaries. We extend OCL for ASR into the unsupervised realm, by leveraging self-training (ST) to facilitate unsupervised adaptation, enabling models to adapt continually without label dependency and without forgetting previous knowledge. Through comparative analysis of various OCL and ST methods across two domain adaptation experiments, we show that UOCL suffers from significantly less forgetting compared to supervised OCL, allowing UOCL methods to approach the performance levels of supervised OCL. Our proposed UOCL extensions further boosts UOCL's efficacy. Our findings represent a significant step towards continually adaptable ASR systems, capable of leveraging unlabeled data across diverse domains.

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyeeckt2024unsupervised

Related papers

• Rehearsal-free Online Continual Learning For Automatic Speech Recognition (2023)5.24
• Continual Learning For Monolingual End-to-end Automatic Speech Recognition (2021)7.16
• Continuously Learning New Words In Automatic Speech Recognition (2024)0.00
• Learning From Flawed Data: Weakly Supervised Automatic Speech Recognition (2023)13.45
• Boosting Cross-domain Speech Recognition With Self-supervision (2022)0.00
• Self-taught Recognizer: Toward Unsupervised Adaptation For Speech Foundation Models (2024)2.26
• Continual Learning Optimizations For Auto-regressive Decoder Of Multilingual ASR Systems (2024)5.84
• Unsupervised Domain Adaptation For Speech Recognition Via Uncertainty Driven Self-training (2020)12.25