Loss Switching Fusion With Similarity Search For Video Classification

Abstract

From video streaming to security and surveillance applications, video data play an important role in our daily living today. However, managing a large amount of video data and retrieving the most useful information for the user remain a challenging task. In this paper, we propose a novel video classification system that would benefit the scene understanding task. We define our classification problem as classifying background and foreground motions using the same feature representation for outdoor scenes. This means that the feature representation needs to be robust enough and adaptable to different classification tasks. We propose a lightweight Loss Switching Fusion Network (LSFNet) for the fusion of spatiotemporal descriptors and a similarity search scheme with soft voting to boost the classification performance. The proposed system has a variety of potential applications such as content-based video clustering, video filtering, etc. Evaluation results on two private industry datasets

Stats

• citations22
• S2 citations—
• github stars0
• HF likes0
• heat score10.21
• arxiv keywang2019loss

Related papers

• Differentiable Resolution Compression And Alignment For Efficient Video Classification And Retrieval (2023)5.27
• Cross-modal Search Method Of Technology Video Based On Adversarial Learning And Feature Fusion (2022)0.00
• Self-supervised Video Similarity Learning (2023)13.04
• An Improved Video Analysis Using Context Based Extension Of LSH (2017)0.00
• Visil: Fine-grained Spatio-temporal Video Similarity Learning (2019)13.70
• Exploiting Local Indexing And Deep Feature Confidence Scores For Fast Image-to-video Search (2018)2.26
• Lightweight Attentional Feature Fusion: A New Baseline For Text-to-video Retrieval (2021)12.02
• Video Retrieval Based On Deep Convolutional Neural Network (2017)9.03