More Photos Are All You Need: Semi-supervised Learning For Fine-grained Sketch Based Image Retrieval
2021 · Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, et al.
Abstract
A fundamental challenge faced by existing Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) models is the data scarcity -- model performances are largely bottlenecked by the lack of sketch-photo pairs. Whilst the number of photos can be easily scaled, each corresponding sketch still needs to be individually produced. In this paper, we aim to mitigate such an upper-bound on sketch data, and study whether unlabelled photos alone (of which they are many) can be cultivated for performances gain. In particular, we introduce a novel semi-supervised framework for cross-modal retrieval that can additionally leverage large-scale unlabelled photos to account for data scarcity. At the centre of our semi-supervision design is a sequential photo-to-sketch generation model that aims to generate paired sketches for unlabelled photos. Importantly, we further introduce a discriminator guided mechanism to guide against unfaithful generation, together with a distillation loss based regularizer to provi
Authors
(none)
Tags
Stats
Related papers
- Exploiting Unlabelled Photos For Stronger Fine-grained SBIR (2023)10.61
- Active Learning For Fine-grained Sketch-based Image Retrieval (2023)0.00
- Sketch Less For More: On-the-fly Fine-grained Sketch Based Image Retrieval (2020)15.28
- Towards Unsupervised Sketch-based Image Retrieval (2021)0.00
- Adaptive Fine-grained Sketch-based Image Retrieval (2022)9.76
- Cross-modal Hierarchical Modelling For Fine-grained Sketch Based Image Retrieval (2020)6.77
- Deep Reinforced Attention Regression For Partial Sketch Based Image Retrieval (2021)5.24
- Data-free Sketch-based Image Retrieval (2023)13.17