A Highly Adaptive Acoustic Model For Accurate Multi-dialect Speech Recognition

Abstract

Despite the success of deep learning in speech recognition, multi-dialect speech recognition remains a difficult problem. Although dialect-specific acoustic models are known to perform well in general, they are not easy to maintain when dialect-specific data is scarce and the number of dialects for each language is large. Therefore, a single unified acoustic model (AM) that generalizes well for many dialects has been in demand. In this paper, we propose a novel acoustic modeling technique for accurate multi-dialect speech recognition with a single AM. Our proposed AM is dynamically adapted based on both dialect information and its internal representation, which results in a highly adaptive AM for handling multiple dialects simultaneously. We also propose a simple but effective training method to deal with unseen dialects. The experimental results on large scale speech datasets show that the proposed AM outperforms all the previous ones, reducing word error rates (WERs) by 8.11% relativ

Stats

• citations27
• S2 citations—
• github stars0
• HF likes0
• heat score10.85
• arxiv keyyoo2022a

Related papers

• Multi-staged Cross-lingual Acoustic Model Adaption For Robust Speech Recognition In Real-world Applications -- A Case Study On German Oral History Interviews (2020)0.00
• Multi-dialect Speech Recognition With A Single Sequence-to-sequence Model (2017)13.79
• Advanced Accent/dialect Identification And Accentedness Assessment With Multi-embedding Models And Automatic Speech Recognition (2023)7.16
• Multi-scale Accent Modeling And Disentangling For Multi-speaker Multi-accent Text-to-speech Synthesis (2024)2.26
• Multi-geometry Spatial Acoustic Modeling For Distant Speech Recognition (2019)6.34
• Multilingual Approach To Joint Speech And Accent Recognition With DNN-HMM Framework (2020)0.00
• Layer-wise Fast Adaptation For End-to-end Multi-accent Speech Recognition (2022)9.76
• A Study Of Enhancement, Augmentation, And Autoencoder Methods For Domain Adaptation In Distant Speech Recognition (2018)8.60