Content-based Image Retrieval And The Semantic Gap In The Deep Learning Era

Abstract

Content-based image retrieval has seen astonishing progress over the past decade, especially for the task of retrieving images of the same object that is depicted in the query image. This scenario is called instance or object retrieval and requires matching fine-grained visual patterns between images. Semantics, however, do not play a crucial role. This brings rise to the question: Do the recent advances in instance retrieval transfer to more generic image retrieval scenarios? To answer this question, we first provide a brief overview of the most relevant milestones of instance retrieval. We then apply them to a semantic image retrieval task and find that they perform inferior to much less sophisticated and more generic methods in a setting that requires image understanding. Following this, we review existing approaches to closing this so-called semantic gap by integrating prior world knowledge. We conclude that the key problem for the further advancement of semantic image retrieval li

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keybarz2020content

Related papers

• A Decade Survey Of Content Based Image Retrieval Using Deep Learning (2020)18.33
• Bridging The Gap Between Local Semantic Concepts And Bag Of Visual Words For Natural Scene Image Retrieval (2022)2.26
• Deep Learning For Instance Retrieval: A Survey (2021)16.05
• Bridging Gap Between Image Pixels And Semantics Via Supervision: A Survey (2021)6.34
• Semantic Image Retrieval By Uniting Deep Neural Networks And Cognitive Architectures (2018)7.16
• Recent Advance In Content-based Image Retrieval: A Literature Survey (2017)0.00
• End-to-end Learning Of Deep Visual Representations For Image Retrieval (2016)19.66
• Advancements In Content-based Image Retrieval: A Comprehensive Survey Of Relevance Feedback Techniques (2023)0.00