Where To Focus: Query Adaptive Matching For Instance Retrieval Using Convolutional Feature Maps

Abstract

Instance retrieval requires one to search for images that contain a particular object within a large corpus. Recent studies show that using image features generated by pooling convolutional layer feature maps (CFMs) of a pretrained convolutional neural network (CNN) leads to promising performance for this task. However, due to the global pooling strategy adopted in those works, the generated image feature is less robust to image clutter and tends to be contaminated by the irrelevant image patterns. In this article, we alleviate this drawback by proposing a novel reranking algorithm using CFMs to refine the retrieval result obtained by existing methods. Our key idea, called query adaptive matching (QAM), is to first represent the CFMs of each image by a set of base regions which can be freely combined into larger regions-of-interest. Then the similarity between the query and a candidate image is measured by the best similarity score that can be attained by comparing the query feature an

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keycao2016where

Related papers

• Class-weighted Convolutional Features For Visual Instance Search (2017)12.81
• What Is The Best Practice For Cnns Applied To Visual Instance Retrieval? (2016)0.00
• REMAP: Multi-layer Entropy-guided Pooling Of Dense CNN Features For Image Retrieval (2019)12.33
• Faster R-CNN Features For Instance Search (2016)14.62
• Co-occurrence Of Deep Convolutional Features For Image Search (2020)9.76
• Context Aware Query Image Representation For Particular Object Retrieval (2017)11.49
• From Selective Deep Convolutional Features To Compact Binary Representations For Image Retrieval (2018)10.35
• Interpretable And Generalizable Person Re-identification With Query-adaptive Convolution And Temporal Lifting (2019)20.43