Domain Adversarial Neural Networks For Dysarthric Speech Recognition

Abstract

Speech recognition systems have improved dramatically over the last few years, however, their performance is significantly degraded for the cases of accented or impaired speech. This work explores domain adversarial neural networks (DANN) for speaker-independent speech recognition on the UAS dataset of dysarthric speech. The classification task on 10 spoken digits is performed using an end-to-end CNN taking raw audio as input. The results are compared to a speaker-adaptive (SA) model as well as speaker-dependent (SD) and multi-task learning models (MTL). The experiments conducted in this paper show that DANN achieves an absolute recognition rate of 74.91% and outperforms the baseline by 12.18%. Additionally, the DANN model achieves comparable results to the SA model's recognition rate of 77.65%. We also observe that when labelled dysarthric speech data is available DANN and MTL perform similarly, but when they are not DANN performs better than MTL.

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keywoszczyk2020domain

Related papers

• Adversarial Learning Of Raw Speech Features For Domain Invariant Speech Recognition (2018)9.23
• Domain Adversarial Training For Accented Speech Recognition (2018)13.84
• Unsupervised Cross-lingual Speech Emotion Recognition Using Domainadversarial Neural Network (2020)0.00
• Domain Adversarial Learning For Emotion Recognition (2019)0.00
• Adversarial Training For Multi-domain Speaker Recognition (2020)6.77
• MADI: Inter-domain Matching And Intra-domain Discrimination For Cross-domain Speech Recognition (2023)7.50
• Optimal Transport-based Adaptation In Dysarthric Speech Tasks (2021)0.00
• Adversarial Data Augmentation Using VAE-GAN For Disordered Speech Recognition (2022)0.00