Learning To Detect Dysarthria From Raw Speech

Abstract

Speech classifiers of paralinguistic traits traditionally learn from diverse hand-crafted low-level features, by selecting the relevant information for the task at hand. We explore an alternative to this selection, by learning jointly the classifier, and the feature extraction. Recent work on speech recognition has shown improved performance over speech features by learning from the waveform. We extend this approach to paralinguistic classification and propose a neural network that can learn a filterbank, a normalization factor and a compression power from the raw speech, jointly with the rest of the architecture. We apply this model to dysarthria detection from sentence-level audio recordings. Starting from a strong attention-based baseline on which mel-filterbanks outperform standard low-level descriptors, we show that learning the filters or the normalization and compression improves over fixed features by 10% absolute accuracy. We also observe a gain over OpenSmile features by lear

Stats

• citations37
• S2 citations—
• github stars0
• HF likes0
• heat score11.85
• arxiv keymillet2018learning

Related papers

• Towards Robust Voice Pathology Detection (2019)13.74
• Optimizing Dysarthria Wake-up Word Spotting: An End-to-end Approach For SLT 2024 LRDWWS Challenge (2024)2.26
• Domain Adversarial Neural Networks For Dysarthric Speech Recognition (2020)7.50
• Robust Vocal Quality Feature Embeddings For Dysphonic Voice Detection (2022)7.16
• Weak-supervised Dysarthria-invariant Features For Spoken Language Understanding Using An FHVAE And Adversarial Training (2022)2.26
• Colm-dsr: Leveraging Neural Codec Language Modeling For Multi-modal Dysarthric Speech Reconstruction (2024)3.58
• An Attention Long Short-term Memory Based System For Automatic Classification Of Speech Intelligibility (2024)12.33
• Enhancing Dysarthric Speech Recognition For Unseen Speakers Via Prototype-based Adaptation (2024)9.45