SLADE: A Self-training Framework For Distance Metric Learning

Abstract

Most existing distance metric learning approaches use fully labeled data to learn the sample similarities in an embedding space. We present a self-training framework, SLADE, to improve retrieval performance by leveraging additional unlabeled data. We first train a teacher model on the labeled data and use it to generate pseudo labels for the unlabeled data. We then train a student model on both labels and pseudo labels to generate final feature embeddings. We use self-supervised representation learning to initialize the teacher model. To better deal with noisy pseudo labels generated by the teacher network, we design a new feature basis learning component for the student network, which learns basis functions of feature representations for unlabeled data. The learned basis vectors better measure the pairwise similarity and are used to select high-confident samples for training the student network. We evaluate our method on standard retrieval benchmarks: CUB-200, Cars-196 and In-shop. Ex

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keyduan2020slade

Related papers

• Self-taught Metric Learning Without Labels (2022)9.41
• Semi-supervised Deep Learning By Metric Embedding (2016)0.00
• Deep Metric Learning Meets Deep Clustering: An Novel Unsupervised Approach For Feature Embedding (2020)2.26
• Learning To Learn In A Semi-supervised Fashion (2020)2.26
• A New Similarity Space Tailored For Supervised Deep Metric Learning (2020)3.58
• S2SD: Simultaneous Similarity-based Self-distillation For Deep Metric Learning (2020)3.31
• Large Scale Local Online Similarity/distance Learning Framework Based On Passive/aggressive (2018)2.26
• Self-supervised Metric Learning In Multi-view Data: A Downstream Task Perspective (2021)3.58