Data Augmentation For End-to-end Code-switching Speech Recognition

Abstract

Training a code-switching end-to-end automatic speech recognition (ASR) model normally requires a large amount of data, while code-switching data is often limited. In this paper, three novel approaches are proposed for code-switching data augmentation. Specifically, they are audio splicing with the existing code-switching data, and TTS with new code-switching texts generated by word translation or word insertion. Our experiments on 200 hours Mandarin-English code-switching dataset show that all the three proposed approaches yield significant improvements on code-switching ASR individually. Moreover, all the proposed approaches can be combined with recent popular SpecAugment, and an addition gain can be obtained. WER is significantly reduced by relative 24.0% compared to the system without any data augmentation, and still relative 13.0% gain compared to the system with only SpecAugment

Stats

• citations20
• S2 citations—
• github stars0
• HF likes0
• heat score9.92
• arxiv keydu2020data

Related papers

• Improving Low Resource Code-switched ASR Using Augmented Code-switched TTS (2020)7.50
• Improving Code-switching And Named Entity Recognition In ASR With Speech Editing Based Data Augmentation (2023)6.34
• Textual Data Augmentation For Arabic-english Code-switching Speech Recognition (2022)6.77
• Code-switching Sentence Generation By Generative Adversarial Networks And Its Application To Data Augmentation (2018)0.00
• Language-agnostic Code-switching In Sequence-to-sequence Speech Recognition (2022)0.00
• Mixspeech: Data Augmentation For Low-resource Automatic Speech Recognition (2021)13.60
• Investigating Lexical Replacements For Arabic-english Code-switched Data Augmentation (2022)5.84
• Constrained Output Embeddings For End-to-end Code-switching Speech Recognition With Only Monolingual Data (2019)7.16