Unified Representation Learning For Cross Model Compatibility

Abstract

We propose a unified representation learning framework to address the Cross Model Compatibility (CMC) problem in the context of visual search applications. Cross compatibility between different embedding models enables the visual search systems to correctly recognize and retrieve identities without re-encoding user images, which are usually not available due to privacy concerns. While there are existing approaches to address CMC in face identification, they fail to work in a more challenging setting where the distributions of embedding models shift drastically. The proposed solution improves CMC performance by introducing a light-weight Residual Bottleneck Transformation (RBT) module and a new training scheme to optimize the embedding spaces. Extensive experiments demonstrate that our proposed solution outperforms previous approaches by a large margin for various challenging visual search scenarios of face recognition and person re-identification.

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keywang2020unified

Related papers

• Towards Backward-compatible Representation Learning (2020)12.93
• Learning Compatible Embeddings (2021)13.80
• Generalized Multi-view Embedding For Visual Recognition And Cross-modal Retrieval (2016)14.69
• Deep Reversible Consistency Learning For Cross-modal Retrieval (2025)7.81
• Forward Compatible Training For Large-scale Embedding Retrieval Systems (2021)8.09
• Towards Cross-modal Backward-compatible Representation Learning For Vision-language Models (2024)0.00
• A Pose-sensitive Embedding For Person Re-identification With Expanded Cross Neighborhood Re-ranking (2017)23.25
• Boundary-aware Backward-compatible Representation Via Adversarial Learning In Image Retrieval (2023)9.21