Stacked Semantic-guided Network For Zero-shot Sketch-based Image Retrieval

Abstract

Zero-shot sketch-based image retrieval (ZS-SBIR) is a task of cross-domain image retrieval from a natural image gallery with free-hand sketch under a zero-shot scenario. Previous works mostly focus on a generative approach that takes a highly abstract and sparse sketch as input and then synthesizes the corresponding natural image. However, the intrinsic visual sparsity and large intra-class variance of the sketch make the learning of the conditional decoder more difficult and hence achieve unsatisfactory retrieval performance. In this paper, we propose a novel stacked semantic-guided network to address the unique characteristics of sketches in ZS-SBIR. Specifically, we devise multi-layer feature fusion networks that incorporate different intermediate feature representation information in a deep neural network to alleviate the intrinsic sparsity of sketches. In order to improve visual knowledge transfer from seen to unseen classes, we elaborate a coarse-to-fine conditional decoder that

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2019stacked

Related papers

• Stacked Adversarial Network For Zero-shot Sketch Based Image Retrieval (2020)10.74
• Semantic Adversarial Network For Zero-shot Sketch-based Image Retrieval (2019)10.74
• An Efficient Framework For Zero-shot Sketch-based Image Retrieval (2021)13.65
• Domain-smoothing Network For Zero-shot Sketch-based Image Retrieval (2021)13.92
• Three-stream Joint Network For Zero-shot Sketch-based Image Retrieval (2022)0.00
• Progressive Domain-independent Feature Decomposition Network For Zero-shot Sketch-based Image Retrieval (2020)11.08
• Relation-aware Meta-learning For Zero-shot Sketch-based Image Retrieval (2024)0.00
• Zero-shot Everything Sketch-based Image Retrieval, And In Explainable Style (2023)16.67