An Empirical Study Of Excitation And Aggregation Design Adaptions In Clip4clip For Video-text Retrieval

Abstract

CLIP4Clip model transferred from the CLIP has been the de-factor standard to solve the video clip retrieval task from frame-level input, triggering the surge of CLIP4Clip-based models in the video-text retrieval domain. In this work, we rethink the inherent limitation of widely-used mean pooling operation in the frame features aggregation and investigate the adaptions of excitation and aggregation design for discriminative video representation generation. We present a novel excitationand-aggregation design, including (1) The excitation module is available for capturing non-mutuallyexclusive relationships among frame features and achieving frame-wise features recalibration, and (2) The aggregation module is applied to learn exclusiveness used for frame representations aggregation. Similarly, we employ the cascade of sequential module and aggregation design to generate discriminative video representation in the sequential type. Besides, we adopt the excitation design in the tight type to

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyjing2024an

Related papers

• Clip4clip: An Empirical Study Of CLIP For End To End Video Clip Retrieval (2021)6.02
• Prompt Switch: Efficient CLIP Adaptation For Text-video Retrieval (2023)11.93
• A Clip-hitchhiker's Guide To Long Video Retrieval (2022)0.00
• Prompt-aware Of Frame Sampling For Efficient Text-video Retrieval (2025)0.95
• Teachclip: Multi-grained Teaching For Efficient Text-to-video Retrieval (2023)0.00
• X-CLIP: End-to-end Multi-grained Contrastive Learning For Video-text Retrieval (2022)18.12
• Centerclip: Token Clustering For Efficient Text-video Retrieval (2022)15.54
• HVD: Human Vision-driven Video Representation Learning For Text-video Retrieval (2026)0.00