Adaptive Fine-grained Sketch-based Image Retrieval

Abstract

The recent focus on Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) has shifted towards generalising a model to new categories without any training data from them. In real-world applications, however, a trained FG-SBIR model is often applied to both new categories and different human sketchers, i.e., different drawing styles. Although this complicates the generalisation problem, fortunately, a handful of examples are typically available, enabling the model to adapt to the new category/style. In this paper, we offer a novel perspective -- instead of asking for a model that generalises, we advocate for one that quickly adapts, with just very few samples during testing (in a few-shot manner). To solve this new problem, we introduce a novel model-agnostic meta-learning (MAML) based framework with several key modifications: (1) As a retrieval task with a margin-based contrastive loss, we simplify the MAML training in the inner loop to make it more stable and tractable. (2) The margin in

Stats

• citations19
• S2 citations—
• github stars0
• HF likes0
• heat score9.76
• arxiv keybhunia2022adaptive

Related papers

• Deep Reinforced Attention Regression For Partial Sketch Based Image Retrieval (2021)5.24
• Active Learning For Fine-grained Sketch-based Image Retrieval (2023)0.00
• Sketch Less For More: On-the-fly Fine-grained Sketch Based Image Retrieval (2020)15.28
• Arnet: Self-supervised FG-SBIR With Unified Sample Feature Alignment And Multi-scale Token Recycling (2024)5.84
• Freeview Sketching: View-aware Fine-grained Sketch-based Image Retrieval (2024)6.34
• More Photos Are All You Need: Semi-supervised Learning For Fine-grained Sketch Based Image Retrieval (2021)13.23
• Exploiting Unlabelled Photos For Stronger Fine-grained SBIR (2023)10.61
• Stylemeup: Towards Style-agnostic Sketch-based Image Retrieval (2021)14.69