Locality Enhanced Dynamic Biasing And Sampling Strategies For Contextual ASR

Abstract

Automatic Speech Recognition (ASR) still face challenges when recognizing time-variant rare-phrases. Contextual biasing (CB) modules bias ASR model towards such contextually-relevant phrases. During training, a list of biasing phrases are selected from a large pool of phrases following a sampling strategy. In this work we firstly analyse different sampling strategies to provide insights into the training of CB for ASR with correlation plots between the bias embeddings among various training stages. Secondly, we introduce a neighbourhood attention (NA) that localizes self attention (SA) to the nearest neighbouring frames to further refine the CB output. The results show that this proposed approach provides on average a 25.84% relative WER improvement on LibriSpeech sets and rare-word evaluation compared to the baseline.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyjalal2024locality

Related papers

• XCB: An Effective Contextual Biasing Approach To Bias Cross-lingual Phrases In Speech Recognition (2024)0.00
• Improving Neural Biasing For Contextual Speech Recognition By Early Context Injection And Text Perturbation (2024)8.09
• Contextualized Automatic Speech Recognition With Attention-based Bias Phrase Boosted Beam Search (2024)8.60
• Robust Acoustic And Semantic Contextual Biasing In Neural Transducers For Speech Recognition (2023)8.60
• Contextualized End-to-end Automatic Speech Recognition With Intermediate Biasing Loss (2024)5.84
• End-to-end Contextual Asr Based On Posterior Distribution Adaptation For Hybrid Ctc/attention System (2022)0.00
• Adaptive Contextual Biasing For Transducer Based Streaming Speech Recognition (2023)7.16
• Towards Contextual Spelling Correction For Customization Of End-to-end Speech Recognition Systems (2022)9.92