A Zero-shot Framework For Sketch-based Image Retrieval

Abstract

Sketch-based image retrieval (SBIR) is the task of retrieving images from a natural image database that correspond to a given hand-drawn sketch. Ideally, an SBIR model should learn to associate components in the sketch (say, feet, tail, etc.) with the corresponding components in the image having similar shape characteristics. However, current evaluation methods simply focus only on coarse-grained evaluation where the focus is on retrieving images which belong to the same class as the sketch but not necessarily having the same shape characteristics as in the sketch. As a result, existing methods simply learn to associate sketches with classes seen during training and hence fail to generalize to unseen classes. In this paper, we propose a new benchmark for zero-shot SBIR where the model is evaluated in novel classes that are not seen during training. We show through extensive experiments that existing models for SBIR that are trained in a discriminative setting learn only class specific

Stats

• citations157
• S2 citations—
• github stars0
• HF likes0
• heat score16.49
• arxiv keyyelamarthi2018a

Related papers

• Relation-aware Meta-learning For Zero-shot Sketch-based Image Retrieval (2024)0.00
• An Efficient Framework For Zero-shot Sketch-based Image Retrieval (2021)13.65
• Generative Model For Zero-shot Sketch-based Image Retrieval (2019)9.23
• Semantic Adversarial Network For Zero-shot Sketch-based Image Retrieval (2019)10.74
• Doodle To Search: Practical Zero-shot Sketch-based Image Retrieval (2019)16.75
• Stacked Semantic-guided Network For Zero-shot Sketch-based Image Retrieval (2019)0.00
• Stacked Adversarial Network For Zero-shot Sketch Based Image Retrieval (2020)10.74
• CLIP For All Things Zero-shot Sketch-based Image Retrieval, Fine-grained Or Not (2023)15.54