Active Learning For Fine-grained Sketch-based Image Retrieval

Abstract

The ability to retrieve a photo by mere free-hand sketching highlights the immense potential of Fine-grained sketch-based image retrieval (FG-SBIR). However, its rapid practical adoption, as well as scalability, is limited by the expense of acquiring faithful sketches for easily available photo counterparts. A solution to this problem is Active Learning, which could minimise the need for labeled sketches while maximising performance. Despite extensive studies in the field, there exists no work that utilises it for reducing sketching effort in FG-SBIR tasks. To this end, we propose a novel active learning sampling technique that drastically minimises the need for drawing photo sketches. Our proposed approach tackles the trade-off between uncertainty and diversity by utilising the relationship between the existing photo-sketch pair to a photo that does not have its sketch and augmenting this relation with its intermediate representations. Since our approach relies only on the underlying

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keythakur2023active

Related papers

• Sketch Less For More: On-the-fly Fine-grained Sketch Based Image Retrieval (2020)15.28
• More Photos Are All You Need: Semi-supervised Learning For Fine-grained Sketch Based Image Retrieval (2021)13.23
• Deep Reinforced Attention Regression For Partial Sketch Based Image Retrieval (2021)5.24
• Adaptive Fine-grained Sketch-based Image Retrieval (2022)9.76
• Exploiting Unlabelled Photos For Stronger Fine-grained SBIR (2023)10.61
• Data-free Sketch-based Image Retrieval (2023)13.17
• Multi-granularity Representation Learning For Sketch-based Dynamic Face Image Retrieval (2023)4.98
• Towards Unsupervised Sketch-based Image Retrieval (2021)0.00