Towards One Model To Rule All: Multilingual Strategy For Dialectal Code-switching Arabic ASR

Abstract

With the advent of globalization, there is an increasing demand for multilingual automatic speech recognition (ASR), handling language and dialectal variation of spoken content. Recent studies show its efficacy over monolingual systems. In this study, we design a large multilingual end-to-end ASR using self-attention based conformer architecture. We trained the system using Arabic (Ar), English (En) and French (Fr) languages. We evaluate the system performance handling: (i) monolingual (Ar, En and Fr); (ii) multi-dialectal (Modern Standard Arabic, along with dialectal variation such as Egyptian and Moroccan); (iii) code-switching -- cross-lingual (Ar-En/Fr) and dialectal (MSA-Egyptian dialect) test cases, and compare with current state-of-the-art systems. Furthermore, we investigate the influence of different embedding/character representations including character vs word-piece; shared vs distinct input symbol per language. Our findings demonstrate the strength of such a model by outpe

Stats

• citations15
• S2 citations—
• github stars0
• HF likes0
• heat score9.03
• arxiv keychowdhury2021towards

Related papers

• Dialectal Coverage And Generalization In Arabic Speech Recognition (2024)4.52
• Language Modeling For Code-switching: Evaluation, Integration Of Monolingual Data, And Discriminative Training (2018)5.24
• Leveraging Data Collection And Unsupervised Learning For Code-switched Tunisian Arabic Automatic Speech Recognition (2023)6.77
• Multilingual Speech Recognition With A Single End-to-end Model (2017)16.05
• Transformer-transducers For Code-switched Speech Recognition (2020)10.97
• Unified Model For Code-switching Speech Recognition And Language Identification Based On A Concatenated Tokenizer (2023)8.09
• A Two-stage Transliteration Approach To Improve Performance Of A Multilingual ASR (2024)0.00
• Textual Data Augmentation For Arabic-english Code-switching Speech Recognition (2022)6.77