Prototype Perturbation For Relaxing Alignment Constraints In Backward-compatible Learning

Abstract

The traditional paradigm to update retrieval models requires re-computing the embeddings of the gallery data, a time-consuming and computationally intensive process known as backfilling. To circumvent backfilling, Backward-Compatible Learning (BCL) has been widely explored, which aims to train a new model compatible with the old one. Many previous works focus on effectively aligning the embeddings of the new model with those of the old one to enhance the backward-compatibility. Nevertheless, such strong alignment constraints would compromise the discriminative ability of the new model, particularly when different classes are closely clustered and hard to distinguish in the old feature space. To address this issue, we propose to relax the constraints by introducing perturbations to the old feature prototypes. This allows us to align the new feature space with a pseudo-old feature space defined by these perturbed prototypes, thereby preserving the discriminative ability of the new model

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhou2025prototype

Related papers

• Backward-compatible Aligned Representations Via An Orthogonal Transformation Layer (2024)0.00
• Privacy-preserving Model Upgrades With Bidirectional Compatible Training In Image Retrieval (2022)0.00
• Towards Backward-compatible Representation Learning (2020)12.93
• Boundary-aware Backward-compatible Representation Via Adversarial Learning In Image Retrieval (2023)9.21
• Metric Compatible Training For Online Backfilling In Large-scale Retrieval (2023)2.26
• Dynamic Gradient Reactivation For Backward Compatible Person Re-identification (2022)5.84
• Forward Compatible Training For Large-scale Embedding Retrieval Systems (2021)8.09
• Towards Cross-modal Backward-compatible Representation Learning For Vision-language Models (2024)0.00