Context Aware Query Image Representation For Particular Object Retrieval

Abstract

The current models of image representation based on Convolutional Neural Networks (CNN) have shown tremendous performance in image retrieval. Such models are inspired by the information flow along the visual pathway in the human visual cortex. We propose that in the field of particular object retrieval, the process of extracting CNN representations from query images with a given region of interest (ROI) can also be modelled by taking inspiration from human vision. Particularly, we show that by making the CNN pay attention on the ROI while extracting query image representation leads to significant improvement over the baseline methods on challenging Oxford5k and Paris6k datasets. Furthermore, we propose an extension to a recently introduced encoding method for CNN representations, regional maximum activations of convolutions (R-MAC). The proposed extension weights the regional representations using a novel saliency measure prior to aggregation. This leads to further improvement in retri

Stats

• citations33
• S2 citations—
• github stars0
• HF likes0
• heat score11.49
• arxiv keylaskar2017context

Related papers

• What Is The Best Practice For Cnns Applied To Visual Instance Retrieval? (2016)0.00
• Adversarial Soft-detection-based Aggregation Network For Image Retrieval (2018)0.00
• Faster R-CNN Features For Instance Search (2016)14.62
• Region-based Contrastive Pretraining For Medical Image Retrieval With Anatomic Query (2023)0.00
• From Selective Deep Convolutional Features To Compact Binary Representations For Image Retrieval (2018)10.35
• Class-weighted Convolutional Features For Visual Instance Search (2017)12.81
• Fine-tuning CNN Image Retrieval With No Human Annotation (2017)22.75
• Where To Focus: Query Adaptive Matching For Instance Retrieval Using Convolutional Feature Maps (2016)0.00