Towards 3D Vr-sketch To 3D Shape Retrieval

Abstract

Growing free online 3D shapes collections dictated research on 3D retrieval. Active debate has however been had on (i) what the best input modality is to trigger retrieval, and (ii) the ultimate usage scenario for such retrieval. In this paper, we offer a different perspective towards answering these questions -- we study the use of 3D sketches as an input modality and advocate a VR-scenario where retrieval is conducted. Thus, the ultimate vision is that users can freely retrieve a 3D model by air-doodling in a VR environment. As a first stab at this new 3D VR-sketch to 3D shape retrieval problem, we make four contributions. First, we code a VR utility to collect 3D VR-sketches and conduct retrieval. Second, we collect the first set of \(167\) 3D VR-sketches on two shape categories from ModelNet. Third, we propose a novel approach to generate a synthetic dataset of human-like 3D sketches of different abstract levels to train deep networks. At last, we compare the common multi-view and

Stats

• citations8
• S2 citations—
• github stars0
• HF likes0
• heat score7.16
• arxiv keyluo2022towards

Related papers

• Structure-aware 3D VR Sketch To 3D Shape Retrieval (2022)8.94
• Fine-grained VR Sketching: Dataset And Insights (2022)7.81
• SHREC'22 Track: Sketch-based 3D Shape Retrieval In The Wild (2022)8.60
• Fine-tuned But Zero-shot 3D Shape Sketch View Similarity And Retrieval (2023)5.24
• Sketchcleannet -- A Deep Learning Approach To The Enhancement And Correction Of Query Sketches For A 3D CAD Model Retrieval System (2022)9.03
• Freeview Sketching: View-aware Fine-grained Sketch-based Image Retrieval (2024)6.34
• Doodle To Search: Practical Zero-shot Sketch-based Image Retrieval (2019)16.75
• Back To The Drawing Board: Rethinking Scene-level Sketch-based Image Retrieval (2025)0.00