Contextualized Streaming End-to-end Speech Recognition With Trie-based Deep Biasing And Shallow Fusion

Abstract

How to leverage dynamic contextual information in end-to-end speech recognition has remained an active research area. Previous solutions to this problem were either designed for specialized use cases that did not generalize well to open-domain scenarios, did not scale to large biasing lists, or underperformed on rare long-tail words. We address these limitations by proposing a novel solution that combines shallow fusion, trie-based deep biasing, and neural network language model contextualization. These techniques result in significant 19.5% relative Word Error Rate improvement over existing contextual biasing approaches and 5.4%-9.3% improvement compared to a strong hybrid baseline on both open-domain and constrained contextualization tasks, where the targets consist of mostly rare long-tail words. Our final system remains lightweight and modular, allowing for quick modification without model re-training.

Stats

• citations61
• S2 citations—
• github stars0
• HF likes0
• heat score13.44
• arxiv keyle2021contextualized

Related papers

• Contextualized End-to-end Automatic Speech Recognition With Intermediate Biasing Loss (2024)5.84
• Adaptive Contextual Biasing For Transducer Based Streaming Speech Recognition (2023)7.16
• Contextualized End-to-end Speech Recognition With Contextual Phrase Prediction Network (2023)10.48
• Improving Neural Biasing For Contextual Speech Recognition By Early Context Injection And Text Perturbation (2024)8.09
• Robust Acoustic And Semantic Contextual Biasing In Neural Transducers For Speech Recognition (2023)8.60
• Improving Contextual Recognition Of Rare Words With An Alternate Spelling Prediction Model (2022)7.81
• Towards Contextual Spelling Correction For Customization Of End-to-end Speech Recognition Systems (2022)9.92
• Two Stage Contextual Word Filtering For Context Bias In Unified Streaming And Non-streaming Transducer (2023)7.16