Indicative Image Retrieval: Turning Blackbox Learning Into Grey

Abstract

Deep learning became the game changer for image retrieval soon after it was introduced. It promotes the feature extraction (by representation learning) as the core of image retrieval, with the relevance/matching evaluation being degenerated into simple similarity metrics. In many applications, we need the matching evidence to be indicated rather than just have the ranked list (e.g., the locations of the target proteins/cells/lesions in medical images). It is like the matched words need to be highlighted in search engines. However, this is not easy to implement without explicit relevance/matching modeling. The deep representation learning models are not feasible because of their blackbox nature. In this paper, we revisit the importance of relevance/matching modeling in deep learning era with an indicative retrieval setting. The study shows that it is possible to skip the representation learning and model the matching evidence directly. By removing the dependency on the pre-trained model

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhang2022indicative

Related papers

• End-to-end Learning Of Deep Visual Representations For Image Retrieval (2016)19.66
• Deep Image Retrieval: Learning Global Representations For Image Search (2016)19.67
• DALG: Deep Attentive Local And Global Modeling For Image Retrieval (2022)0.00
• Unifying Deep Local And Global Features For Image Search (2020)28.10
• Evaluating Contrastive Models For Instance-based Image Retrieval (2021)5.24
• Instance Image Retrieval By Learning Purely From Within The Dataset (2022)0.00
• A Study On The Interpretability Of Neural Retrieval Models Using Deepshap (2019)13.44
• Image Retrieval Methods In The Dissimilarity Space (2024)0.00