Latent-inr: A Flexible Framework For Implicit Representations Of Videos With Discriminative Semantics

Abstract

Implicit Neural Networks (INRs) have emerged as powerful representations to encode all forms of data, including images, videos, audios, and scenes. With video, many INRs for video have been proposed for the compression task, and recent methods feature significant improvements with respect to encoding time, storage, and reconstruction quality. However, these encoded representations lack semantic meaning, so they cannot be used for any downstream tasks that require such properties, such as retrieval. This can act as a barrier for adoption of video INRs over traditional codecs as they do not offer any significant edge apart from compression. To alleviate this, we propose a flexible framework that decouples the spatial and temporal aspects of the video INR. We accomplish this with a dictionary of per-frame latents that are learned jointly with a set of video specific hypernetworks, such that given a latent, these hypernetworks can predict the INR weights to reconstruct the given frame. Thi

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keymaiya2024latent

Related papers

• Differentiable Resolution Compression And Alignment For Efficient Video Classification And Retrieval (2023)5.27
• Unifying Latent And Lexicon Representations For Effective Video-text Retrieval (2024)0.00
• Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework (2020)18.58
• Lazyvlm: Neuro-symbolic Approach To Video Analytics (2025)0.00
• TV-RAG: A Temporal-aware And Semantic Entropy-weighted Framework For Long Video Retrieval And Understanding (2025)2.86
• Encode The Unseen: Predictive Video Hashing For Scalable Mid-stream Retrieval (2020)3.58
• Prior Knowledge Integration Via LLM Encoding And Pseudo Event Regulation For Video Moment Retrieval (2024)13.83
• Prompt Switch: Efficient CLIP Adaptation For Text-video Retrieval (2023)11.93