PSA-MF: Personality-sentiment Aligned Multi-level Fusion For Multimodal Sentiment Analysis
2025 · Heng Xie, Kang Zhu, Zhengqi Wen, et al.
Abstract
Multimodal sentiment analysis (MSA) is a research field that recognizes human sentiments by combining textual, visual, and audio modalities. The main challenge lies in integrating sentiment-related information from different modalities, which typically arises during the unimodal feature extraction phase and the multimodal feature fusion phase. Existing methods extract only shallow information from unimodal features during the extraction phase, neglecting sentimental differences across different personalities. During the fusion phase, they directly merge the feature information from each modality without considering differences at the feature level. This ultimately affects the model's recognition performance. To address this problem, we propose a personality-sentiment aligned multi-level fusion framework. We introduce personality traits during the feature extraction phase and propose a novel personality-sentiment alignment method to obtain personalized sentiment embeddings from the text
Authors
(none)
Tags
Stats
Related papers
- DLF: Disentangled-language-focused Multimodal Sentiment Analysis (2024)4.26
- MIAR: Modality Interaction And Alignment Representation Fuison For Multimodal Emotion (2026)0.00
- Scalevlad: Improving Multimodal Sentiment Analysis Via Multi-scale Fusion Of Locally Descriptors (2021)0.00
- MSF-SER: Enriching Acoustic Modeling With Multi-granularity Semantics For Speech Emotion Recognition (2025)0.00
- Enhancing Multimodal Sentiment Analysis For Missing Modality Through Self-distillation And Unified Modality Cross-attention (2024)6.71
- Audio-guided Fusion Techniques For Multimodal Emotion Analysis (2024)4.52
- On The Use Of Modality-specific Large-scale Pre-trained Encoders For Multimodal Sentiment Analysis (2022)6.77
- Enriching Multimodal Sentiment Analysis Through Textual Emotional Descriptions Of Visual-audio Content (2024)10.48