Progressive Neural Networks For Transfer Learning In Emotion Recognition

Abstract

Many paralinguistic tasks are closely related and thus representations learned in one domain can be leveraged for another. In this paper, we investigate how knowledge can be transferred between three paralinguistic tasks: speaker, emotion, and gender recognition. Further, we extend this problem to cross-dataset tasks, asking how knowledge captured in one emotion dataset can be transferred to another. We focus on progressive neural networks and compare these networks to the conventional deep learning method of pre-training and fine-tuning. Progressive neural networks provide a way to transfer knowledge and avoid the forgetting effect present when pre-training neural networks on different tasks. Our experiments demonstrate that: (1) emotion recognition can benefit from using representations originally learned for different paralinguistic tasks and (2) transfer learning can effectively leverage additional datasets to improve the performance of emotion recognition systems.

Stats

• citations77
• S2 citations—
• github stars0
• HF likes0
• heat score14.19
• arxiv keygideon2017progressive

Related papers

• Transfer Learning For Improving Speech Emotion Classification Accuracy (2018)15.10
• Multi-modal Emotion Detection With Transfer Learning (2020)0.00
• Embedded Emotions -- A Data Driven Approach To Learn Transferable Feature Representations From Raw Speech Input For Emotion Recognition (2020)0.00
• A Transfer Learning Method For Speech Emotion Recognition From Automatic Speech Recognition (2020)0.00
• Multimodal Emotion Recognition Using Transfer Learning From Speaker Recognition And Bert-based Models (2022)12.10
• Continuous Metric Learning For Transferable Speech Emotion Recognition And Embedding Across Low-resource Languages (2022)0.00
• End-to-end Transfer Learning For Speaker-independent Cross-language And Cross-corpus Speech Emotion Recognition (2023)0.00
• Emonet: A Transfer Learning Framework For Multi-corpus Speech Emotion Recognition (2021)2.95