Graph Based Temporal Aggregation For Video Retrieval

Abstract

Large scale video retrieval is a field of study with a lot of ongoing research. Most of the work in the field is on video retrieval through text queries using techniques such as VSE++. However, there is little research done on video retrieval through image queries, and the work that has been done in this field either uses image queries from within the video dataset or iterates through videos frame by frame. These approaches are not generalized for queries from outside the dataset and do not scale well for large video datasets. To overcome these issues, we propose a new approach for video retrieval through image queries where an undirected graph is constructed from the combined set of frames from all videos to be searched. The node features of this graph are used in the task of video retrieval. Experimentation is done on the MSR-VTT dataset by using query images from outside the dataset. To evaluate this novel approach P@5, P@10 and P@20 metrics are calculated. Two different ResNet mode

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keysrinivasan2020graph

Related papers

• VRAG: Region Attention Graphs For Content-based Video Retrieval (2022)0.00
• Towards Efficient And Robust Moment Retrieval System: A Unified Framework For Multi-granularity Models And Temporal Reranking (2025)2.26
• Tree-augmented Cross-modal Encoding For Complex-query Video Retrieval (2020)15.57
• RAVU: Retrieval Augmented Video Understanding With Compositional Reasoning Over Graph (2025)0.00
• Temporal Context Aggregation For Video Retrieval With Contrastive Learning (2020)13.23
• Fine-grained Video-text Retrieval With Hierarchical Graph Reasoning (2020)18.27
• A Lightweight Moment Retrieval System With Global Re-ranking And Robust Adaptive Bidirectional Temporal Search (2025)3.58
• Neural Graph Matching For Video Retrieval In Large-scale Video-driven E-commerce (2024)0.00