Bridging The Gap Between Monaural Speech Enhancement And Recognition With Distortion-independent Acoustic Modeling

Abstract

Monaural speech enhancement has made dramatic advances since the introduction of deep learning a few years ago. Although enhanced speech has been demonstrated to have better intelligibility and quality for human listeners, feeding it directly to automatic speech recognition (ASR) systems trained with noisy speech has not produced expected improvements in ASR performance. The lack of an enhancement benefit on recognition, or the gap between monaural speech enhancement and recognition, is often attributed to speech distortions introduced in the enhancement process. In this study, we analyze the distortion problem, compare different acoustic models, and investigate a distortion-independent training scheme for monaural speech recognition. Experimental results suggest that distortion-independent acoustic modeling is able to overcome the distortion problem. Such an acoustic model can also work with speech enhancement models different from the one used during training. Moreover, the models in

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keywang2019bridging

Related papers

• Distortionless Multi-channel Target Speech Enhancement For Overlapped Speech Recognition (2020)0.00
• Reducing The Gap Between Pretrained Speech Enhancement And Recognition Models Using A Real Speech-trained Bridging Module (2025)2.26
• Bridging The Gap: Integrating Pre-trained Speech Enhancement And Recognition Models For Robust Speech Recognition (2024)7.50
• Rethinking Processing Distortions: Disentangling The Impact Of Speech Enhancement Errors On Speech Recognition Performance (2024)8.35
• Effect Of Noise Suppression Losses On Speech Distortion And ASR Performance (2021)10.74
• On Monoaural Speech Enhancement For Automatic Recognition Of Real Noisy Speech Using Mixture Invariant Training (2022)4.52
• Frequency Domain Multi-channel Acoustic Modeling For Distant Speech Recognition (2019)9.92
• Fat-hubert: Front-end Adaptive Training Of Hidden-unit BERT For Distortion-invariant Robust Speech Recognition (2023)6.34