X-vectors Meet Emotions: A Study On Dependencies Between Emotion And Speaker Recognition
2020 · Raghavendra Pappagari, Tianzi Wang, Jesus Villalba, et al.
Abstract
In this work, we explore the dependencies between speaker recognition and emotion recognition. We first show that knowledge learned for speaker recognition can be reused for emotion recognition through transfer learning. Then, we show the effect of emotion on speaker recognition. For emotion recognition, we show that using a simple linear model is enough to obtain good performance on the features extracted from pre-trained models such as the x-vector model. Then, we improve emotion recognition performance by fine-tuning for emotion classification. We evaluated our experiments on three different types of datasets: IEMOCAP, MSP-Podcast, and Crema-D. By fine-tuning, we obtained 30.40%, 7.99%, and 8.61% absolute improvement on IEMOCAP, MSP-Podcast, and Crema-D respectively over baseline model with no pre-training. Finally, we present results on the effect of emotion on speaker verification. We observed that speaker verification performance is prone to changes in test speaker emotions. We f
Authors
(none)
Tags
Stats
Related papers
- Emotion Invariant Speaker Embeddings For Speaker Identification With Emotional Speech (2020)0.00
- Is Style All You Need? Dependencies Between Emotion And Gst-based Speaker Recognition (2022)0.00
- Transforming The Embeddings: A Lightweight Technique For Speech Emotion Recognition Tasks (2023)7.50
- Vocal Style Factorization For Effective Speaker Recognition In Affective Scenarios (2023)0.00
- Probing The Information Encoded In X-vectors (2019)13.23
- Embedded Emotions -- A Data Driven Approach To Learn Transferable Feature Representations From Raw Speech Input For Emotion Recognition (2020)0.00
- Revealing Emotional Clusters In Speaker Embeddings: A Contrastive Learning Strategy For Speech Emotion Recognition (2024)7.81
- Emoformer: A Text-independent Speech Emotion Recognition Using A Hybrid Transformer-cnn Model (2025)6.34