End-to-end Triplet Loss Based Emotion Embedding System For Speech Emotion Recognition
2020 · Puneet Kumar, Sidharth Jain, Balasubramanian Raman, et al.
Abstract
In this paper, an end-to-end neural embedding system based on triplet loss and residual learning has been proposed for speech emotion recognition. The proposed system learns the embeddings from the emotional information of the speech utterances. The learned embeddings are used to recognize the emotions portrayed by given speech samples of various lengths. The proposed system implements Residual Neural Network architecture. It is trained using softmax pre-training and triplet loss function. The weights between the fully connected and embedding layers of the trained network are used to calculate the embedding values. The embedding representations of various emotions are mapped onto a hyperplane, and the angles among them are computed using the cosine similarity. These angles are utilized to classify a new speech sample into its appropriate emotion class. The proposed system has demonstrated 91.67% and 64.44% accuracy while recognizing emotions for RAVDESS and IEMOCAP dataset, respectivel
Authors
(none)
Tags
Stats
Related papers
- Speech Emotion Recognition Via Contrastive Loss Under Siamese Networks (2019)12.17
- Focal Loss Based Residual Convolutional Neural Network For Speech Emotion Recognition (2019)0.00
- Extending Rnn-t-based Speech Recognition Systems With Emotion And Language Classification (2022)4.52
- Deep Learning Based Emotion Recognition System Using Speech Features And Transcriptions (2019)0.00
- Emotech: A Multi-modal Speech Emotion Recognition Using Multi-source Low-level Information With Hybrid Recurrent Network (2025)8.35
- Is Style All You Need? Dependencies Between Emotion And Gst-based Speaker Recognition (2022)0.00
- Triplet Based Embedding Distance And Similarity Learning For Text-independent Speaker Verification (2019)5.24
- Generative Data Augmentation Guided By Triplet Loss For Speech Emotion Recognition (2022)3.58