Stylemeup: Towards Style-agnostic Sketch-based Image Retrieval

Abstract

Sketch-based image retrieval (SBIR) is a cross-modal matching problem which is typically solved by learning a joint embedding space where the semantic content shared between photo and sketch modalities are preserved. However, a fundamental challenge in SBIR has been largely ignored so far, that is, sketches are drawn by humans and considerable style variations exist amongst different users. An effective SBIR model needs to explicitly account for this style diversity, crucially, to generalise to unseen user styles. To this end, a novel style-agnostic SBIR model is proposed. Different from existing models, a cross-modal variational autoencoder (VAE) is employed to explicitly disentangle each sketch into a semantic content part shared with the corresponding photo, and a style part unique to the sketcher. Importantly, to make our model dynamically adaptable to any unseen user styles, we propose to meta-train our cross-modal VAE by adding two style-adaptive components: a set of feature tran

Stats

• citations90
• S2 citations—
• github stars0
• HF likes0
• heat score14.69
• arxiv keysain2021stylemeup

Related papers

• Cross-modal Subspace Learning For Fine-grained Sketch-based Image Retrieval (2017)13.34
• Back To The Drawing Board: Rethinking Scene-level Sketch-based Image Retrieval (2025)0.00
• Adaptive Fine-grained Sketch-based Image Retrieval (2022)9.76
• Sketch Less For More: On-the-fly Fine-grained Sketch Based Image Retrieval (2020)15.28
• Generative Model For Zero-shot Sketch-based Image Retrieval (2019)9.23
• Sketch And Text Synergy: Fusing Structural Contours And Descriptive Attributes For Fine-grained Image Retrieval (2026)0.00
• Relation-aware Meta-learning For Zero-shot Sketch-based Image Retrieval (2024)0.00
• Data-free Sketch-based Image Retrieval (2023)13.17