Symmetrical Bidirectional Knowledge Alignment For Zero-shot Sketch-based Image Retrieval

Abstract

This paper studies the problem of zero-shot sketch-based image retrieval (ZS-SBIR), which aims to use sketches from unseen categories as queries to match the images of the same category. Due to the large cross-modality discrepancy, ZS-SBIR is still a challenging task and mimics realistic zero-shot scenarios. The key is to leverage transferable knowledge from the pre-trained model to improve generalizability. Existing researchers often utilize the simple fine-tuning training strategy or knowledge distillation from a teacher model with fixed parameters, lacking efficient bidirectional knowledge alignment between student and teacher models simultaneously for better generalization. In this paper, we propose a novel Symmetrical Bidirectional Knowledge Alignment for zero-shot sketch-based image retrieval (SBKA). The symmetrical bidirectional knowledge alignment learning framework is designed to effectively learn mutual rich discriminative information between teacher and student models to ach

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyliu2023symmetrical

Related papers

• Relation-aware Meta-learning For Zero-shot Sketch-based Image Retrieval (2024)0.00
• Adapt And Align To Improve Zero-shot Sketch-based Image Retrieval (2023)0.00
• Semantic Adversarial Network For Zero-shot Sketch-based Image Retrieval (2019)10.74
• Bda-sketret: Bi-level Domain Adaptation For Zero-shot SBIR (2022)10.35
• Modality-aware Representation Learning For Zero-shot Sketch-based Image Retrieval (2024)8.60
• Distribution Aligned Feature Clustering For Zero-shot Sketch-based Image Retrieval (2023)0.00
• Stacked Semantic-guided Network For Zero-shot Sketch-based Image Retrieval (2019)0.00
• A Zero-shot Framework For Sketch-based Image Retrieval (2018)16.49