Beyond Supervised Vs. Unsupervised: Representative Benchmarking And Analysis Of Image Representation Learning
2022 · Matthew Gwilliam, Abhinav Shrivastava
Abstract
By leveraging contrastive learning, clustering, and other pretext tasks, unsupervised methods for learning image representations have reached impressive results on standard benchmarks. The result has been a crowded field - many methods with substantially different implementations yield results that seem nearly identical on popular benchmarks, such as linear evaluation on ImageNet. However, a single result does not tell the whole story. In this paper, we compare methods using performance-based benchmarks such as linear evaluation, nearest neighbor classification, and clustering for several different datasets, demonstrating the lack of a clear front-runner within the current state-of-the-art. In contrast to prior work that performs only supervised vs. unsupervised comparison, we compare several different unsupervised methods against each other. To enrich this comparison, we analyze embeddings with measurements such as uniformity, tolerance, and centered kernel alignment (CKA), and propos
Authors
(none)
Tags
Stats
Related papers
- Revisiting Contrastive Methods For Unsupervised Learning Of Visual Representations (2021)3.91
- Feature Representation Learning For Unsupervised Cross-domain Image Retrieval (2022)11.46
- SUVR: A Search-based Approach To Unsupervised Visual Representation Learning (2023)3.58
- With A Little Help From My Friends: Nearest-neighbor Contrastive Learning Of Visual Representations (2021)18.76
- QK Iteration: A Self-supervised Representation Learning Algorithm For Image Similarity (2021)0.00
- Unsupervised Feature Learning Via Non-parametric Instance-level Discrimination (2018)25.66
- Evaluating Contrastive Models For Instance-based Image Retrieval (2021)5.24
- Unsupervised High-level Feature Learning By Ensemble Projection For Semi-supervised Image Classification And Image Clustering (2016)0.00