FS-COCO: Towards Understanding Of Freehand Sketches Of Common Objects In Context

Abstract

We advance sketch research to scenes with the first dataset of freehand scene sketches, FS-COCO. With practical applications in mind, we collect sketches that convey scene content well but can be sketched within a few minutes by a person with any sketching skills. Our dataset comprises 10,000 freehand scene vector sketches with per point space-time information by 100 non-expert individuals, offering both object- and scene-level abstraction. Each sketch is augmented with its text description. Using our dataset, we study for the first time the problem of fine-grained image retrieval from freehand scene sketches and sketch captions. We draw insights on: (i) Scene salience encoded in sketches using the strokes temporal order; (ii) Performance comparison of image retrieval from a scene sketch and an image caption; (iii) Complementarity of information in sketches and image captions, as well as the potential benefit of combining the two modalities. In addition, we extend a popular vector sket

Stats

• citations38
• S2 citations—
• github stars0
• HF likes0
• heat score11.93
• arxiv keychowdhury2022fs

Related papers

• Back To The Drawing Board: Rethinking Scene-level Sketch-based Image Retrieval (2025)0.00
• A Sketch Is Worth A Thousand Words: Image Retrieval With Text And Sketch (2022)10.35
• Deep Self-supervised Representation Learning For Free-hand Sketch (2020)12.25
• Sketchtriplet: Self-supervised Scenarized Sketch-text-image Triplet Generation (2024)4.52
• Partially Does It: Towards Scene-level FG-SBIR With Partial Input (2022)10.97
• Deep Factorised Inverse-sketching (2018)8.35
• Sketch And Text Synergy: Fusing Structural Contours And Descriptive Attributes For Fine-grained Image Retrieval (2026)0.00
• Freeview Sketching: View-aware Fine-grained Sketch-based Image Retrieval (2024)6.34