Object Category Learning And Retrieval With Weak Supervision

Abstract

We consider the problem of retrieving objects from image data and learning to classify them into meaningful semantic categories with minimal supervision. To that end, we propose a fully differentiable unsupervised deep clustering approach to learn semantic classes in an end-to-end fashion without individual class labeling using only unlabeled object proposals. The key contributions of our work are 1) a kmeans clustering objective where the clusters are learned as parameters of the network and are represented as memory units, and 2) simultaneously building a feature representation, or embedding, while learning to cluster it. This approach shows promising results on two popular computer vision datasets: on CIFAR10 for clustering objects, and on the more complex and challenging Cityscapes dataset for semantically discovering classes which visually correspond to cars, people, and bicycles. Currently, the only supervision provided is segmentation objectness masks, but this method can be ext

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhickson2018object

Related papers

• Unsupervised High-level Feature Learning By Ensemble Projection For Semi-supervised Image Classification And Image Clustering (2016)0.00
• Feature Representation Learning For Unsupervised Cross-domain Image Retrieval (2022)11.46
• Unsupervised Part Learning For Visual Recognition (2017)8.82
• Beyond Supervised Vs. Unsupervised: Representative Benchmarking And Analysis Of Image Representation Learning (2022)8.35
• Large-scale Product Retrieval With Weakly Supervised Representation Learning (2022)0.00
• Unsupervised Object Discovery For Instance Recognition (2017)6.77
• Joint Representation Learning And Novel Category Discovery On Single- And Multi-modal Data (2021)13.11
• Towards Unsupervised Sketch-based Image Retrieval (2021)0.00