Investigating Target Set Reduction For End-to-end Speech Recognition Of Hindi-english Code-switching Data

Abstract

End-to-end (E2E) systems are fast replacing the conventional systems in the domain of automatic speech recognition. As the target labels are learned directly from speech data, the E2E systems need a bigger corpus for effective training. In the context of code-switching task, the E2E systems face two challenges: (i) the expansion of the target set due to multiple languages involved, and (ii) the lack of availability of sufficiently large domain-specific corpus. Towards addressing those challenges, we propose an approach for reducing the number of target labels for reliable training of the E2E systems on limited data. The efficacy of the proposed approach has been demonstrated on two prominent architectures, namely CTC-based and attention-based E2E networks. The experimental validations are performed on a recently created Hindi-English code-switching corpus. For contrast purpose, the results for the full target set based E2E system and a hybrid DNN-HMM system are also reported.

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keydhawan2019investigating

Related papers

• End-to-end ASR For Code-switched Hindi-english Speech (2019)0.00
• Joint Language Identification Of Code-switching Speech Using Attention Based E2E Network (2019)5.24
• Balanced End-to-end Monolingual Pre-training For Low-resourced Indic Languages Code-switching Speech Recognition (2021)0.00
• On The End-to-end Solution To Mandarin-english Code-switching Speech Recognition (2018)12.10
• An Effective Mixture-of-experts Approach For Code-switching Speech Recognition Leveraging Encoder Disentanglement (2024)0.00
• Integrating Knowledge In End-to-end Automatic Speech Recognition For Mandarin-english Code-switching (2021)5.24
• Towards End-to-end Code-switching Speech Recognition (2018)0.00
• Language-agnostic Code-switching In Sequence-to-sequence Speech Recognition (2022)0.00