Improving Speech Emotion Recognition Through Focus And Calibration Attention Mechanisms
2022 · Junghun Kim, Yoojin An, Jihie Kim
Abstract
Attention has become one of the most commonly used mechanisms in deep learning approaches. The attention mechanism can help the system focus more on the feature space's critical regions. For example, high amplitude regions can play an important role for Speech Emotion Recognition (SER). In this paper, we identify misalignments between the attention and the signal amplitude in the existing multi-head self-attention. To improve the attention area, we propose to use a Focus-Attention (FA) mechanism and a novel Calibration-Attention (CA) mechanism in combination with the multi-head self-attention. Through the FA mechanism, the network can detect the largest amplitude part in the segment. By employing the CA mechanism, the network can modulate the information flow by assigning different weights to each attention head and improve the utilization of surrounding contexts. To evaluate the proposed method, experiments are performed with the IEMOCAP and RAVDESS datasets. Experimental results show
Authors
(none)
Tags
Stats
Related papers
- Speech Emotion Recognition With Multiscale Area Attention And Data Augmentation (2021)13.65
- Attention Based Fully Convolutional Network For Speech Emotion Recognition (2018)15.25
- Enhanced Speech Emotion Recognition With Efficient Channel Attention Guided Deep Cnn-bilstm Framework (2024)0.00
- Conversational Emotion Analysis Via Attention Mechanisms (2019)10.35
- Speech Emotion Recognition With Co-attention Based Multi-level Acoustic Information (2022)16.17
- Metadata-enhanced Speech Emotion Recognition: Augmented Residual Integration And Co-attention In Two-stage Fine-tuning (2024)5.24
- Effect Of Attention And Self-supervised Speech Embeddings On Non-semantic Speech Tasks (2023)4.52
- MF-AED-AEC: Speech Emotion Recognition By Leveraging Multimodal Fusion, Asr Error Detection, And Asr Error Correction (2024)0.00