Pronunciation-aware Unique Character Encoding For RNN Transducer-based Mandarin Speech Recognition

Abstract

For Mandarin end-to-end (E2E) automatic speech recognition (ASR) tasks, compared to character-based modeling units, pronunciation-based modeling units could improve the sharing of modeling units in model training but meet homophone problems. In this study, we propose to use a novel pronunciation-aware unique character encoding for building E2E RNN-T-based Mandarin ASR systems. The proposed encoding is a combination of pronunciation-base syllable and character index (CI). By introducing the CI, the RNN-T model can overcome the homophone problem while utilizing the pronunciation information for extracting modeling units. With the proposed encoding, the model outputs can be converted into the final recognition result through a one-to-one mapping. We conducted experiments on Aishell and MagicData datasets, and the experimental results showed the effectiveness of the proposed method.

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keyshen2022pronunciation

Related papers

• Cascade Rnn-transducer: Syllable Based Streaming On-device Mandarin Speech Recognition With A Syllable-to-character Converter (2020)9.92
• Research On Modeling Units Of Transformer Transducer For Mandarin Speech Recognition (2020)0.00
• A Comparison Of Modeling Units In Sequence-to-sequence Speech Recognition With The Transformer On Mandarin Chinese (2018)11.39
• Attention-based End-to-end Speech Recognition On Voice Search (2017)0.00
• Rnn-transducer With Language Bias For End-to-end Mandarin-english Code-switching Speech Recognition (2020)8.09
• Effectiveasr: A Single-step Non-autoregressive Mandarin Speech Recognition Architecture With High Accuracy And Inference Speed (2024)3.58
• Retraining-free Customized ASR For Enharmonic Words Based On A Named-entity-aware Model And Phoneme Similarity Estimation (2023)4.52
• Mandarin Tone Modeling Using Recurrent Neural Networks (2017)0.00