Mintrec: A New Dataset For Multimodal Intent Recognition
2022 · Hanlei Zhang, Hua Xu, Xin Wang, et al.
Abstract
Multimodal intent recognition is a significant task for understanding human language in real-world multimodal scenes. Most existing intent recognition methods have limitations in leveraging the multimodal information due to the restrictions of the benchmark datasets with only text information. This paper introduces a novel dataset for multimodal intent recognition (MIntRec) to address this issue. It formulates coarse-grained and fine-grained intent taxonomies based on the data collected from the TV series Superstore. The dataset consists of 2,224 high-quality samples with text, video, and audio modalities and has multimodal annotations among twenty intent categories. Furthermore, we provide annotated bounding boxes of speakers in each video segment and achieve an automatic process for speaker annotation. MIntRec is helpful for researchers to mine relationships between different modalities to enhance the capability of intent recognition. We extract features from each modality and model
Authors
(none)
Tags
Stats
Related papers
- WDMIR: Wavelet-driven Multimodal Intent Recognition (2025)2.26
- Token-level Contrastive Learning With Modality-aware Prompting For Multimodal Intent Recognition (2023)14.17
- SMART: Shot-aware Multimodal Video Moment Retrieval With Audio-enhanced MLLM (2025)0.00
- Multimodal Emotion Recognition And Sentiment Analysis In Multi-party Conversation Contexts (2025)0.00
- Getting The Subtext Without The Text: Scalable Multimodal Sentiment Classification From Visual And Acoustic Modalities (2018)7.50
- Fine-grained Grounding For Multimodal Speech Recognition (2020)5.84
- Mmtrail: A Multimodal Trailer Video Dataset With Language And Music Descriptions (2024)0.00
- Semantic Matters: Multimodal Features For Affective Analysis (2025)0.00