Acnet: Approaching-and-centralizing Network For Zero-shot Sketch-based Image Retrieval

Abstract

The huge domain gap between sketches and photos and the highly abstract sketch representations pose challenges for sketch-based image retrieval (\underline\{SBIR\}). The zero-shot sketch-based image retrieval (\underline\{ZS-SBIR\}) is more generic and practical but poses an even greater challenge because of the additional knowledge gap between the seen and unseen categories. To simultaneously mitigate both gaps, we propose an \textbf\{A\}pproaching-and-\textbf\{C\}entralizing \textbf\{Net\}work (termed "\textbf\{ACNet\}") to jointly optimize sketch-to-photo synthesis and the image retrieval. The retrieval module guides the synthesis module to generate large amounts of diverse photo-like images which gradually approach the photo domain, and thus better serve the retrieval module than ever to learn domain-agnostic representations and category-agnostic common knowledge for generalizing to unseen categories. These diverse images generated with retrieval guidance can effectively alleviate

Stats

• citations26
• S2 citations—
• github stars0
• HF likes0
• heat score10.74
• arxiv keyren2021acnet

Related papers

• Domain-smoothing Network For Zero-shot Sketch-based Image Retrieval (2021)13.92
• An Efficient Framework For Zero-shot Sketch-based Image Retrieval (2021)13.65
• Semantic Adversarial Network For Zero-shot Sketch-based Image Retrieval (2019)10.74
• CLIP For All Things Zero-shot Sketch-based Image Retrieval, Fine-grained Or Not (2023)15.54
• Doodle To Search: Practical Zero-shot Sketch-based Image Retrieval (2019)16.75
• Stacked Semantic-guided Network For Zero-shot Sketch-based Image Retrieval (2019)0.00
• Stacked Adversarial Network For Zero-shot Sketch Based Image Retrieval (2020)10.74
• Crossatnet - A Novel Cross-attention Based Framework For Sketch-based Image Retrieval (2021)11.29