Ontology-aware Network For Zero-shot Sketch-based Image Retrieval

Abstract

Zero-Shot Sketch-Based Image Retrieval (ZSSBIR) is an emerging task. The pioneering work focused on the modal gap but ignored inter-class information. Although recent work has begun to consider the triplet-based or contrast-based loss to mine inter-class information, positive and negative samples need to be carefully selected, or the model is prone to lose modality-specific information. To respond to these issues, an Ontology-Aware Network (OAN) is proposed. Specifically, the smooth inter-class independence learning mechanism is put forward to maintain inter-class peculiarity. Meanwhile, distillation-based consistency preservation is utilized to keep modality-specific information. Extensive experiments have demonstrated the superior performance of our algorithm on two challenging Sketchy and Tu-Berlin datasets.

Stats

• citations6
• S2 citations—
• github stars0
• HF likes0
• heat score6.34
• arxiv keyzhang2023ontology

Related papers

• Domain-smoothing Network For Zero-shot Sketch-based Image Retrieval (2021)13.92
• Semantic Adversarial Network For Zero-shot Sketch-based Image Retrieval (2019)10.74
• Stacked Adversarial Network For Zero-shot Sketch Based Image Retrieval (2020)10.74
• Relation-aware Meta-learning For Zero-shot Sketch-based Image Retrieval (2024)0.00
• Stacked Semantic-guided Network For Zero-shot Sketch-based Image Retrieval (2019)0.00
• An Efficient Framework For Zero-shot Sketch-based Image Retrieval (2021)13.65
• Modality-aware Representation Learning For Zero-shot Sketch-based Image Retrieval (2024)8.60
• Three-stream Joint Network For Zero-shot Sketch-based Image Retrieval (2022)0.00