Self-supervised Metric Learning In Multi-view Data: A Downstream Task Perspective

Abstract

Self-supervised metric learning has been a successful approach for learning a distance from an unlabeled dataset. The resulting distance is broadly useful for improving various distance-based downstream tasks, even when no information from downstream tasks is utilized in the metric learning stage. To gain insights into this approach, we develop a statistical framework to theoretically study how self-supervised metric learning can benefit downstream tasks in the context of multi-view data. Under this framework, we show that the target distance of metric learning satisfies several desired properties for the downstream tasks. On the other hand, our investigation suggests the target distance can be further improved by moderating each direction's weights. In addition, our analysis precisely characterizes the improvement by self-supervised metric learning on four commonly used downstream tasks: sample identification, two-sample testing, \(k\)-means clustering, and \(k\)-nearest neighbor clas

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keywang2021self

Related papers

• Self-taught Metric Learning Without Labels (2022)9.41
• Deep Metric Learning Assisted By Intra-variance In A Semi-supervised View Of Learning (2023)5.24
• Self-weighted Multiview Metric Learning By Maximizing The Cross Correlations (2019)0.00
• SLADE: A Self-training Framework For Distance Metric Learning (2020)6.77
• Self-supervised Auxiliary Loss For Metric Learning In Music Similarity-based Retrieval And Auto-tagging (2023)0.00
• Semi-supervised Deep Learning By Metric Embedding (2016)0.00
• Piecewise-linear Manifolds For Deep Metric Learning (2024)0.00
• Deep Metric Learning Beyond Binary Supervision (2019)14.39