Sync From The Sea: Retrieving Alignable Videos From Large-scale Datasets

Abstract

Temporal video alignment aims to synchronize the key events like object interactions or action phase transitions in two videos. Such methods could benefit various video editing, processing, and understanding tasks. However, existing approaches operate under the restrictive assumption that a suitable video pair for alignment is given, significantly limiting their broader applicability. To address this, we re-pose temporal alignment as a search problem and introduce the task of Alignable Video Retrieval (AVR). Given a query video, our approach can identify well-alignable videos from a large collection of clips and temporally synchronize them to the query. To achieve this, we make three key contributions: 1) we introduce DRAQ, a video alignability indicator to identify and re-rank the best alignable video from a set of candidates; 2) we propose an effective and generalizable frame-level video feature design to improve the alignment performance of several off-the-shelf feature representati

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keydave2024sync

Related papers

• Learning Segment Similarity And Alignment In Large-scale Content Based Video Retrieval (2023)11.08
• Tokenbinder: Text-video Retrieval With One-to-many Alignment Paradigm (2024)4.52
• T2VLAD: Global-local Sequence Alignment For Text-video Retrieval (2021)16.65
• Differentiable Resolution Compression And Alignment For Efficient Video Classification And Retrieval (2023)5.27
• Granalign: Granularity-aware Alignment Framework For Zero-shot Video Moment Retrieval (2026)0.00
• Towards Efficient And Robust Moment Retrieval System: A Unified Framework For Multi-granularity Models And Temporal Reranking (2025)2.26
• X-aligner: Composed Visual Retrieval Without The Bells And Whistles (2026)0.00
• A Lightweight Moment Retrieval System With Global Re-ranking And Robust Adaptive Bidirectional Temporal Search (2025)3.58