Improving Distinction Between ASR Errors And Speech Disfluencies With Feature Space Interpolation

Abstract

Fine-tuning pretrained language models (LMs) is a popular approach to automatic speech recognition (ASR) error detection during post-processing. While error detection systems often take advantage of statistical language archetypes captured by LMs, at times the pretrained knowledge can hinder error detection performance. For instance, presence of speech disfluencies might confuse the post-processing system into tagging disfluent but accurate transcriptions as ASR errors. Such confusion occurs because both error detection and disfluency detection tasks attempt to identify tokens at statistically unlikely positions. This paper proposes a scheme to improve existing LM-based ASR error detection systems, both in terms of detection scores and resilience to such distracting auxiliary tasks. Our approach adopts the popular mixup method in text feature space and can be utilized with any black-box ASR output. To demonstrate the effectiveness of our method, we conduct post-processing experiments w

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypark2021improving

Related papers

• ASR Error Management For Improving Spoken Language Understanding (2017)9.92
• Multi-stage Large Language Model Correction For Speech Recognition (2023)0.00
• Acoustic Feature Mixup For Balanced Multi-aspect Pronunciation Assessment (2024)2.26
• ML-LMCL: Mutual Learning And Large-margin Contrastive Learning For Improving ASR Robustness In Spoken Language Understanding (2023)0.00
• Enhancing Naturalness In Llm-generated Utterances Through Disfluency Insertion (2024)0.00
• Speech Recognition With Llms Adapted To Disordered Speech Using Reinforcement Learning (2024)5.24
• Cross-modal ASR Post-processing System For Error Correction And Utterance Rejection (2022)0.00
• End-to-end Speech Recognition And Disfluency Removal With Acoustic Language Model Pretraining (2023)0.00