Attention Based Fully Convolutional Network For Speech Emotion Recognition

Abstract

Speech emotion recognition is a challenging task for three main reasons: 1) human emotion is abstract, which means it is hard to distinguish; 2) in general, human emotion can only be detected in some specific moments during a long utterance; 3) speech data with emotional labeling is usually limited. In this paper, we present a novel attention based fully convolutional network for speech emotion recognition. We employ fully convolutional network as it is able to handle variable-length speech, free of the demand of segmentation to keep critical information not lost. The proposed attention mechanism can make our model be aware of which time-frequency region of speech spectrogram is more emotion-relevant. Considering limited data, the transfer learning is also adapted to improve the accuracy. Especially, it's interesting to observe obvious improvement obtained with natural scene image based pre-trained model. Validated on the publicly available IEMOCAP corpus, the proposed model outperform

Stats

• citations107
• S2 citations—
• github stars0
• HF likes0
• heat score15.25
• arxiv keyzhang2018attention

Related papers

• Attentive Convolutional Neural Network Based Speech Emotion Recognition: A Study On The Impact Of Input Features, Signal Length, And Acted Speech (2017)16.14
• Light-sernet: A Lightweight Fully Convolutional Neural Network For Speech Emotion Recognition (2021)14.90
• Speech Emotion Recognition With Multiscale Area Attention And Data Augmentation (2021)13.65
• Focal Loss Based Residual Convolutional Neural Network For Speech Emotion Recognition (2019)0.00
• Searching For Effective Preprocessing Method And Cnn-based Architecture With Efficient Channel Attention On Speech Emotion Recognition (2024)2.26
• Speech Emotion Recognition With Co-attention Based Multi-level Acoustic Information (2022)16.17
• Attention-based Region Of Interest (ROI) Detection For Speech Emotion Recognition (2022)0.00
• Emotion Recognition System From Speech And Visual Information Based On Convolutional Neural Networks (2020)10.21