Investigation Of Deep Neural Network Acoustic Modelling Approaches For Low Resource Accented Mandarin Speech Recognition

Abstract

The Mandarin Chinese language is known to be strongly influenced by a rich set of regional accents, while Mandarin speech with each accent is quite low resource. Hence, an important task in Mandarin speech recognition is to appropriately model the acoustic variabilities imposed by accents. In this paper, an investigation of implicit and explicit use of accent information on a range of deep neural network (DNN) based acoustic modelling techniques is conducted. Meanwhile, approaches of multi-accent modelling including multi-style training, multi-accent decision tree state tying, DNN tandem and multi-level adaptive network (MLAN) tandem hidden Markov model (HMM) modelling are combined and compared in this paper. On a low resource accented Mandarin speech recognition task consisting of four regional accents, an improved MLAN tandem HMM systems explicitly leveraging the accent information was proposed and significantly outperformed the baseline accent independent DNN tandem systems by 0.8%-

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyxie2022investigation

Related papers

• Multilingual Approach To Joint Speech And Accent Recognition With DNN-HMM Framework (2020)0.00
• Empirical Evaluation Of Speaker Adaptation On DNN Based Acoustic Model (2018)5.24
• A Highly Adaptive Acoustic Model For Accurate Multi-dialect Speech Recognition (2022)10.85
• Research On Modeling Units Of Transformer Transducer For Mandarin Speech Recognition (2020)0.00
• Generating Mandarin And Cantonese F0 Contours With Decision Trees And Blstms (2018)0.00
• Advanced Accent/dialect Identification And Accentedness Assessment With Multi-embedding Models And Automatic Speech Recognition (2023)7.16
• Decoupling And Interacting Multi-task Learning Network For Joint Speech And Accent Recognition (2023)9.03
• Non-linear Pairwise Language Mappings For Low-resource Multilingual Acoustic Model Fusion (2022)0.00