Advanced Accent/dialect Identification And Accentedness Assessment With Multi-embedding Models And Automatic Speech Recognition

Abstract

Accurately classifying accents and assessing accentedness in non-native speakers are both challenging tasks due to the complexity and diversity of accent and dialect variations. In this study, embeddings from advanced pre-trained language identification (LID) and speaker identification (SID) models are leveraged to improve the accuracy of accent classification and non-native accentedness assessment. Findings demonstrate that employing pre-trained LID and SID models effectively encodes accent/dialect information in speech. Furthermore, the LID and SID encoded accent information complement an end-to-end accent identification (AID) model trained from scratch. By incorporating all three embeddings, the proposed multi-embedding AID system achieves superior accuracy in accent identification. Next, we investigate leveraging automatic speech recognition (ASR) and accent identification models to explore accentedness estimation. The ASR model is an end-to-end connectionist temporal classificatio

Stats

• citations8
• S2 citations—
• github stars0
• HF likes0
• heat score7.16
• arxiv keyghorbani2023advanced

Related papers

• Accent-robust Automatic Speech Recognition Using Supervised And Unsupervised Wav2vec Embeddings (2021)0.00
• Streaming Language Identification Using Combination Of Acoustic Representations And ASR Hypotheses (2020)0.00
• Leveraging Native Language Speech For Accent Identification Using Deep Siamese Networks (2017)7.50
• Convolutional Neural Networks And Language Embeddings For End-to-end Dialect Recognition (2018)12.40
• A Highly Adaptive Acoustic Model For Accurate Multi-dialect Speech Recognition (2022)10.85
• Multi-scale Accent Modeling And Disentangling For Multi-speaker Multi-accent Text-to-speech Synthesis (2024)2.26
• Deep Learning For Speaker Identification: Architectural Insights From AB-1 Corpus Analysis And Performance Evaluation (2024)0.00
• English Accent Accuracy Analysis In A State-of-the-art Automatic Speech Recognition System (2021)0.00