TIMIT Speaker Profiling: A Comparison Of Multi-task Learning And Single-task Learning Approaches

Abstract

This study employs deep learning techniques to explore four speaker profiling tasks on the TIMIT dataset, namely gender classification, accent classification, age estimation, and speaker identification, highlighting the potential and challenges of multi-task learning versus single-task models. The motivation for this research is twofold: firstly, to empirically assess the advantages and drawbacks of multi-task learning over single-task models in the context of speaker profiling; secondly, to emphasize the undiminished significance of skillful feature engineering for speaker recognition tasks. The findings reveal challenges in accent classification, and multi-task learning is found advantageous for tasks of similar complexity. Non-sequential features are favored for speaker recognition, but sequential ones can serve as starting points for complex models. The study underscores the necessity of meticulous experimentation and parameter tuning for deep learning models.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2024timit

Related papers

• Leveraging Speaker Attribute Information Using Multi Task Learning For Speaker Verification And Diarization (2020)6.34
• To Reverse The Gradient Or Not: An Empirical Comparison Of Adversarial And Multi-task Learning In Speech Recognition (2018)9.59
• Multi-view Multi-task Modeling With Speech Foundation Models For Speech Forensic Tasks (2024)0.00
• Learning Speaker Representation With Semi-supervised Learning Approach For Speaker Profiling (2021)0.00
• Speaker- And Age-invariant Training For Child Acoustic Modeling Using Adversarial Multi-task Learning (2022)0.00
• Leveraging Speaker Embeddings With Adversarial Multi-task Learning For Age Group Classification (2023)0.00
• Jointly Detecting And Separating Singing Voice: A Multi-task Approach (2018)7.81
• Deep Learning For Speaker Identification: Architectural Insights From AB-1 Corpus Analysis And Performance Evaluation (2024)0.00