Semi-supervised Deep Learning By Metric Embedding
2016 Β· Elad Hoffer, Nir Ailon
Abstract
Deep networks are successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are usually much less suited for semi-supervised problems because of their tendency to overfit easily when trained on small amounts of data. In this work we will explore a new training objective that is targeting a semi-supervised regime with only a small subset of labeled data. This criterion is based on a deep metric embedding over distance relations within the set of labeled samples, together with constraints over the embeddings of the unlabeled set. The final learned representations are discriminative in euclidean space, and hence can be used with subsequent nearest-neighbor classification using the labeled samples.
Authors
(none)
Tags
Stats
Related papers
- Deep Metric Learning Assisted By Intra-variance In A Semi-supervised View Of Learning (2023)5.24
- Metric Learning By Similarity Network For Deep Semi-supervised Learning (2020)3.58
- Deep Metric Learning-based Semi-supervised Regression With Alternate Learning (2022)5.24
- Self-taught Metric Learning Without Labels (2022)9.41
- Deep Metric Learning For Computer Vision: A Brief Overview (2023)6.77
- Deep Metric Learning Meets Deep Clustering: An Novel Unsupervised Approach For Feature Embedding (2020)2.26
- Semi-supervised Learning Using Siamese Networks (2021)7.50
- Learning Intra-batch Connections For Deep Metric Learning (2021)0.00