Image Retrieval And Pattern Spotting Using Siamese Neural Network

Abstract

This paper presents a novel approach for image retrieval and pattern spotting in document image collections. The manual feature engineering is avoided by learning a similarity-based representation using a Siamese Neural Network trained on a previously prepared subset of image pairs from the ImageNet dataset. The learned representation is used to provide the similarity-based feature maps used to find relevant image candidates in the data collection given an image query. A robust experimental protocol based on the public Tobacco800 document image collection shows that the proposed method compares favorably against state-of-the-art document image retrieval methods, reaching 0.94 and 0.83 of mean average precision (mAP) for retrieval and pattern spotting (IoU=0.7), respectively. Besides, we have evaluated the proposed method considering feature maps of different sizes, showing the impact of reducing the number of features in the retrieval performance and time-consuming.

Stats

• citations34
• S2 citations—
• github stars0
• HF likes0
• heat score11.58
• arxiv keywiggers2019image

Related papers

• Deep Learning Approaches For Image Retrieval And Pattern Spotting In Ancient Documents (2019)0.00
• Pattern Spotting And Image Retrieval In Historical Documents Using Deep Hashing (2022)2.26
• Retrieval Of Family Members Using Siamese Neural Network (2020)7.81
• Siamese Network Of Deep Fisher-vector Descriptors For Image Retrieval (2017)0.00
• Learning Deep Representations Of Medical Images Using Siamese Cnns With Application To Content-based Image Retrieval (2017)0.00
• Semi-supervised Learning Using Siamese Networks (2021)7.50
• An Experimental Evaluation Of Siamese Neural Networks For Robot Localization Using Omnidirectional Imaging In Indoor Environments (2024)6.34
• Retrieving Similar E-commerce Images Using Deep Learning (2019)0.00