Self-relation Attention And Temporal Awareness For Emotion Recognition Via Vocal Burst
2022 · Dang-Linh Trinh, Minh-Cong Vo, Guee-Sang Lee
Abstract
The technical report presents our emotion recognition pipeline for high-dimensional emotion task (A-VB High) in The ACII Affective Vocal Bursts (A-VB) 2022 Workshop \& Competition. Our proposed method contains three stages. Firstly, we extract the latent features from the raw audio signal and its Mel-spectrogram by self-supervised learning methods. Then, the features from the raw signal are fed to the self-relation attention and temporal awareness (SA-TA) module for learning the valuable information between these latent features. Finally, we concatenate all the features and utilize a fully-connected layer to predict each emotion's score. By empirical experiments, our proposed method achieves a mean concordance correlation coefficient (CCC) of 0.7295 on the test set, compared to 0.5686 on the baseline model. The code of our method is available at https://github.com/linhtd812/A-VB2022.
Authors
(none)
Tags
Stats
Code
Related papers
- Self-supervised Attention Networks And Uncertainty Loss Weighting For Multi-task Emotion Recognition On Vocal Bursts (2022)0.00
- Classification Of Vocal Bursts For ACII 2022 A-vb-type Competition Using Convolutional Neural Networks And Deep Acoustic Embeddings (2022)0.00
- Exploring The Effectiveness Of Self-supervised Learning And Classifier Chains In Emotion Recognition Of Nonverbal Vocalizations (2022)0.00
- An Efficient Multitask Learning Architecture For Affective Vocal Burst Analysis (2022)0.00
- Continuous Multimodal Emotion Recognition Approach For AVEC 2017 (2017)0.00
- Mutilmodal Feature Extraction And Attention-based Fusion For Emotion Estimation In Videos (2023)1.40
- Multimodal Fusion Method With Spatiotemporal Sequences And Relationship Learning For Valence-arousal Estimation (2024)0.00
- SUN Team's Contribution To ABAW 2024 Competition: Audio-visual Valence-arousal Estimation And Expression Recognition (2024)0.00