Automatic Speech Recognition Using Advanced Deep Learning Approaches: A Survey

Abstract

Recent advancements in deep learning (DL) have posed a significant challenge for automatic speech recognition (ASR). ASR relies on extensive training datasets, including confidential ones, and demands substantial computational and storage resources. Enabling adaptive systems improves ASR performance in dynamic environments. DL techniques assume training and testing data originate from the same domain, which is not always true. Advanced DL techniques like deep transfer learning (DTL), federated learning (FL), and reinforcement learning (RL) address these issues. DTL allows high-performance models using small yet related datasets, FL enables training on confidential data without dataset possession, and RL optimizes decision-making in dynamic environments, reducing computation costs. This survey offers a comprehensive review of DTL, FL, and RL-based ASR frameworks, aiming to provide insights into the latest developments and aid researchers and professionals in understanding the current ch

Stats

• citations164
• S2 citations—
• github stars0
• HF likes0
• heat score16.63
• arxiv keykheddar2024automatic

Related papers

• Deep Learning For Distant Speech Recognition (2017)0.00
• Deep Neural Networks For Automatic Speech Processing: A Survey From Large Corpora To Limited Data (2020)0.00
• Visualizing Automatic Speech Recognition -- Means For A Better Understanding? (2022)4.52
• Distributed Training Of Deep Neural Network Acoustic Models For Automatic Speech Recognition (2020)0.00
• Transfer Learning-based Deep Residual Learning For Speech Recognition In Clean And Noisy Environments (2025)3.58
• Deep Representation Learning In Speech Processing: Challenges, Recent Advances, And Future Trends (2020)0.00
• Bigssl: Exploring The Frontier Of Large-scale Semi-supervised Learning For Automatic Speech Recognition (2021)15.73
• Enabling Differentially Private Federated Learning For Speech Recognition: Benchmarks, Adaptive Optimizers And Gradient Clipping (2023)2.56