Self-supervised Attention Networks And Uncertainty Loss Weighting For Multi-task Emotion Recognition On Vocal Bursts

Abstract

Vocal bursts play an important role in communicating affect, making them valuable for improving speech emotion recognition. Here, we present our approach for classifying vocal bursts and predicting their emotional significance in the ACII Affective Vocal Burst Workshop & Challenge 2022 (A-VB). We use a large self-supervised audio model as shared feature extractor and compare multiple architectures built on classifier chains and attention networks, combined with uncertainty loss weighting strategies. Our approach surpasses the challenge baseline by a wide margin on all four tasks.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keykaras2022self

Related papers

• Dynamic Restrained Uncertainty Weighting Loss For Multitask Learning Of Vocal Expression (2022)0.00
• Self-relation Attention And Temporal Awareness For Emotion Recognition Via Vocal Burst (2022)4.18
• An Efficient Multitask Learning Architecture For Affective Vocal Burst Analysis (2022)0.00
• Burst2vec: An Adversarial Multi-task Approach For Predicting Emotion, Age, And Origin From Vocal Bursts (2022)0.00
• Multitask Vocal Burst Modeling With Resnets And Pre-trained Paralinguistic Conformers (2022)0.00
• Classification Of Vocal Bursts For ACII 2022 A-vb-type Competition Using Convolutional Neural Networks And Deep Acoustic Embeddings (2022)0.00
• Self-supervision And Learnable Strfs For Age, Emotion, And Country Prediction (2022)0.00
• Attention-augmented End-to-end Multi-task Learning For Emotion Prediction From Speech (2019)13.50