Saliency Weighted Convolutional Features For Instance Search

Abstract

This work explores attention models to weight the contribution of local convolutional representations for the instance search task. We present a retrieval framework based on bags of local convolutional features (BLCF) that benefits from saliency weighting to build an efficient image representation. The use of human visual attention models (saliency) allows significant improvements in retrieval performance without the need to conduct region analysis or spatial verification, and without requiring any feature fine tuning. We investigate the impact of different saliency models, finding that higher performance on saliency benchmarks does not necessarily equate to improved performance when used in instance search tasks. The proposed approach outperforms the state-of-the-art on the challenging INSTRE benchmark by a large margin, and provides similar performance on the Oxford and Paris benchmarks compared to more complex methods that use off-the-shelf representations. The source code used in t

Stats

• citations20
• S2 citations—
• github stars0
• HF likes0
• heat score9.92
• arxiv keymohedano2017saliency

Related papers

• Class-weighted Convolutional Features For Visual Instance Search (2017)12.81
• Can Image Retrieval Help Visual Saliency Detection? (2017)0.00
• Saliency Map-based Image Retrieval Using Invariant Krawtchouk Moments (2024)0.00
• Unsupervised Object Discovery For Instance Recognition (2017)6.77
• Faster R-CNN Features For Instance Search (2016)14.62
• Context Aware Query Image Representation For Particular Object Retrieval (2017)11.49
• All The Attention You Need: Global-local, Spatial-channel Attention For Image Retrieval (2021)13.97
• Where To Focus: Query Adaptive Matching For Instance Retrieval Using Convolutional Feature Maps (2016)0.00