Hierarchical Network With Decoupled Knowledge Distillation For Speech Emotion Recognition

Abstract

The goal of Speech Emotion Recognition (SER) is to enable computers to recognize the emotion category of a given utterance in the same way that humans do. The accuracy of SER is strongly dependent on the validity of the utterance-level representation obtained by the model. Nevertheless, the ``dark knowledge" carried by non-target classes is always ignored by previous studies. In this paper, we propose a hierarchical network, called DKDFMH, which employs decoupled knowledge distillation in a deep convolutional neural network with a fused multi-head attention mechanism. Our approach applies logit distillation to obtain higher-level semantic features from different scales of attention sets and delve into the knowledge carried by non-target classes, thus guiding the model to focus more on the differences between sentiment features. To validate the effectiveness of our model, we conducted experiments on the Interactive Emotional Dyadic Motion Capture (IEMOCAP) dataset. We achieved competiti

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keyzhao2023hierarchical

Related papers

• Multi-level Knowledge Distillation For Speech Emotion Recognition In Noisy Conditions (2023)7.81
• Multi-teacher Language-aware Knowledge Distillation For Multilingual Speech Emotion Recognition (2025)0.00
• Speech Emotion Recognition With Distilled Prosodic And Linguistic Affect Representations (2023)5.24
• Dsnet: Disentangled Siamese Network With Neutral Calibration For Speech Emotion Recognition (2023)0.00
• Hybrid Data Augmentation And Deep Attention-based Dilated Convolutional-recurrent Neural Networks For Speech Emotion Recognition (2021)12.81
• MFSN: Multi-perspective Fusion Search Network For Pre-training Knowledge In Speech Emotion Recognition (2023)0.00
• Speech Emotion: Investigating Model Representations, Multi-task Learning And Knowledge Distillation (2022)6.34
• Deep Residual Local Feature Learning For Speech Emotion Recognition (2020)7.16