Relation-aware Meta-learning For Zero-shot Sketch-based Image Retrieval

Abstract

Sketch-based image retrieval (SBIR) relies on free-hand sketches to retrieve natural photos within the same class. However, its practical application is limited by its inability to retrieve classes absent from the training set. To address this limitation, the task has evolved into Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR), where model performance is evaluated on unseen categories. Traditional SBIR primarily focuses on narrowing the domain gap between photo and sketch modalities. However, in the zero-shot setting, the model not only needs to address this cross-modal discrepancy but also requires a strong generalization capability to transfer knowledge to unseen categories. To this end, we propose a novel framework for ZS-SBIR that employs a pair-based relation-aware quadruplet loss to bridge feature gaps. By incorporating two negative samples from different modalities, the approach prevents positive features from becoming disproportionately distant from one modality while remaini

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyliu2024relation

Related papers

• Modality-aware Representation Learning For Zero-shot Sketch-based Image Retrieval (2024)8.60
• A Zero-shot Framework For Sketch-based Image Retrieval (2018)16.49
• Semantic Adversarial Network For Zero-shot Sketch-based Image Retrieval (2019)10.74
• Domain-smoothing Network For Zero-shot Sketch-based Image Retrieval (2021)13.92
• An Efficient Framework For Zero-shot Sketch-based Image Retrieval (2021)13.65
• Stacked Adversarial Network For Zero-shot Sketch Based Image Retrieval (2020)10.74
• Stacked Semantic-guided Network For Zero-shot Sketch-based Image Retrieval (2019)0.00
• Symmetrical Bidirectional Knowledge Alignment For Zero-shot Sketch-based Image Retrieval (2023)4.52