Movie Trailer Genre Classification Using Multimodal Pretrained Features
2024 · Serkan Sulun, Paula Viana, Matthew E. P. Davies
Abstract
We introduce a novel method for movie genre classification, capitalizing on a diverse set of readily accessible pretrained models. These models extract high-level features related to visual scenery, objects, characters, text, speech, music, and audio effects. To intelligently fuse these pretrained features, we train small classifier models with low time and memory requirements. Employing the transformer model, our approach utilizes all video and audio frames of movie trailers without performing any temporal pooling, efficiently exploiting the correspondence between all elements, as opposed to the fixed and low number of frames typically used by traditional methods. Our approach fuses features originating from different tasks and modalities, with different dimensionalities, different temporal lengths, and complex dependencies as opposed to current approaches. Our method outperforms state-of-the-art movie genre classification models in terms of precision, recall, and mean average precisi
Authors
(none)
Tags
Stats
Related papers
- Multilevel Profiling Of Situation And Dialogue-based Deep Networks For Movie Genre Classification Using Movie Trailers (2021)0.00
- Mmtrail: A Multimodal Trailer Video Dataset With Language And Music Descriptions (2024)0.00
- Multimodal Open-vocabulary Video Classification Via Pre-trained Vision And Language Models (2022)0.00
- Multi-modal Emotion Recognition By Text, Speech And Video Using Pretrained Transformers (2024)0.00
- A Novel Multimodal Music Genre Classifier Using Hierarchical Attention And Convolutional Neural Network (2020)0.00
- Multimodal Frame-scoring Transformer For Video Summarization (2022)0.00
- Efficient Selective Audio Masked Multimodal Bottleneck Transformer For Audio-video Classification (2024)0.00
- Getting The Subtext Without The Text: Scalable Multimodal Sentiment Classification From Visual And Acoustic Modalities (2018)7.50