Content-based Landmark Retrieval Combining Global And Local Features Using Siamese Neural Networks

Abstract

In this work, we present a method for landmark retrieval that utilizes global and local features. A Siamese network is used for global feature extraction and metric learning, which gives an initial ranking of the landmark search. We utilize the extracted feature maps from the Siamese architecture as local descriptors, the search results are then further refined using a cosine similarity between local descriptors. We conduct a deeper analysis of the Google Landmark Dataset, which is used for evaluation, and augment the dataset to handle various intra-class variances. Furthermore, we conduct several experiments to compare the effects of transfer learning and metric learning, as well as experiments using other local descriptors. We show that a re-ranking using local features can improve the search results. We believe that the proposed local feature extraction using cosine similarity is a simple approach that can be extended to many other retrieval tasks.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhu2022content

Related papers

• Two-stage Discriminative Re-ranking For Large-scale Landmark Retrieval (2020)15.20
• Semi-supervised Exploration In Image Retrieval (2019)0.00
• Large-scale Landmark Retrieval/recognition Under A Noisy And Diverse Dataset (2019)0.00
• Large-scale Image Retrieval With Attentive Deep Local Features (2016)30.63
• Efficient Large-scale Image Retrieval With Deep Feature Orthogonality And Hybrid-swin-transformers (2021)0.00
• Learning Super-features For Image Retrieval (2022)4.31
• Deep Image Retrieval: Learning Global Representations For Image Search (2016)19.67
• 3rd Place Solution To "google Landmark Retrieval 2020" (2020)0.00