Dns: Distill-and-select For Efficient And Accurate Video Indexing And Retrieval

Abstract

In this paper, we address the problem of high performance and computationally efficient content-based video retrieval in large-scale datasets. Current methods typically propose either: (i) fine-grained approaches employing spatio-temporal representations and similarity calculations, achieving high performance at a high computational cost or (ii) coarse-grained approaches representing/indexing videos as global vectors, where the spatio-temporal structure is lost, providing low performance but also having low computational cost. In this work, we propose a Knowledge Distillation framework, called Distill-and-Select (DnS), that starting from a well-performing fine-grained Teacher Network learns: a) Student Networks at different retrieval performance and computational efficiency trade-offs and b) a Selector Network that at test time rapidly directs samples to the appropriate student to maintain both high retrieval performance and high computational efficiency. We train several students with

Stats

• citations31
• S2 citations—
• github stars70
• HF likes0
• heat score14.99
• arxiv keykordopatiszilos2021dns

Related papers

• TEACHTEXT: Crossmodal Generalized Distillation For Text-video Retrieval (2021)15.43
• Towards A Smaller Student: Capacity Dynamic Distillation For Efficient Image Retrieval (2023)10.07
• Dual Learning With Dynamic Knowledge Distillation And Soft Alignment For Partially Relevant Video Retrieval (2025)2.60
• Data-efficient Ranking Distillation For Image Retrieval (2020)0.00
• Embeddistill: A Geometric Knowledge Distillation For Information Retrieval (2023)0.00
• Towards Efficient And Robust Moment Retrieval System: A Unified Framework For Multi-granularity Models And Temporal Reranking (2025)2.26
• Exploiting Local Indexing And Deep Feature Confidence Scores For Fast Image-to-video Search (2018)2.26
• Context Unaware Knowledge Distillation For Image Retrieval (2022)0.60