Joint Learning Of 3D Shape Retrieval And Deformation
2021 · Mikaela Angelina Uy, Vladimir G. Kim, Minhyuk Sung, et al.
Abstract
We propose a novel technique for producing high-quality 3D models that match a given target object image or scan. Our method is based on retrieving an existing shape from a database of 3D models and then deforming its parts to match the target shape. Unlike previous approaches that independently focus on either shape retrieval or deformation, we propose a joint learning procedure that simultaneously trains the neural deformation module along with the embedding space used by the retrieval module. This enables our network to learn a deformation-aware embedding space, so that retrieved models are more amenable to match the target after an appropriate deformation. In fact, we use the embedding space to guide the shape pairs used to train the deformation module, so that it invests its capacity in learning deformations between meaningful shape pairs. Furthermore, our novel part-aware deformation module can work with inconsistent and diverse part-structures on the source shapes. We demonstrat
Authors
(none)
Tags
Stats
Related papers
- Deformation-aware 3D Model Embedding And Retrieval (2020)10.74
- KP-RED: Exploiting Semantic Keypoints For Joint 3D Shape Retrieval And Deformation (2024)8.35
- Extending Deepsdf For Automatic 3D Shape Retrieval And Similarity Transform Estimation (2020)0.00
- Structure-aware 3D VR Sketch To 3D Shape Retrieval (2022)8.94
- U-RED: Unsupervised 3D Shape Retrieval And Deformation For Partial Point Clouds (2023)8.09
- Enhancing Deformable Local Features By Jointly Learning To Detect And Describe Keypoints (2023)9.59
- Gram Regularization For Multi-view 3D Shape Retrieval (2020)0.00
- Shapematcher: Self-supervised Joint Shape Canonicalization, Segmentation, Retrieval And Deformation (2023)6.77