Convolutional Patch Representations For Image Retrieval: An Unsupervised Approach

Abstract

Convolutional neural networks (CNNs) have recently received a lot of attention due to their ability to model local stationary structures in natural images in a multi-scale fashion, when learning all model parameters with supervision. While excellent performance was achieved for image classification when large amounts of labeled visual data are available, their success for un-supervised tasks such as image retrieval has been moderate so far. Our paper focuses on this latter setting and explores several methods for learning patch descriptors without supervision with application to matching and instance-level retrieval. To that effect, we propose a new family of convolutional descriptors for patch representation , based on the recently introduced convolutional kernel networks. We show that our descriptor, named Patch-CKN, performs better than SIFT as well as other convolutional networks learned by artificially introducing supervision and is significantly faster to train. To demonstrate it

Stats

• citations45
• S2 citations—
• github stars0
• HF likes0
• heat score12.47
• arxiv keypaulin2016convolutional

Related papers

• Pn-net: Conjoined Triple Deep Network For Learning Local Image Descriptors (2016)0.00
• Transformer-based Clipped Contrastive Quantization Learning For Unsupervised Image Retrieval (2024)5.84
• Patch-wise Retrieval: A Bag Of Practical Techniques For Instance-level Matching (2025)0.00
• Unsupervised Natural Image Patch Learning (2018)8.82
• From Selective Deep Convolutional Features To Compact Binary Representations For Image Retrieval (2018)10.35
• Patch Reordering: A Novel Way To Achieve Rotation And Translation Invariance In Convolutional Neural Networks (2019)4.55
• Investigating The Vision Transformer Model For Image Retrieval Tasks (2021)10.74
• Class-weighted Convolutional Features For Visual Instance Search (2017)12.81