KP-RED: Exploiting Semantic Keypoints For Joint 3D Shape Retrieval And Deformation

Abstract

In this paper, we present KP-RED, a unified KeyPoint-driven REtrieval and Deformation framework that takes object scans as input and jointly retrieves and deforms the most geometrically similar CAD models from a pre-processed database to tightly match the target. Unlike existing dense matching based methods that typically struggle with noisy partial scans, we propose to leverage category-consistent sparse keypoints to naturally handle both full and partial object scans. Specifically, we first employ a lightweight retrieval module to establish a keypoint-based embedding space, measuring the similarity among objects by dynamically aggregating deformation-aware local-global features around extracted keypoints. Objects that are close in the embedding space are considered similar in geometry. Then we introduce the neural cage-based deformation module that estimates the influence vector of each keypoint upon cage vertices inside its local support region to control the deformation of the retr

Stats

• citations5
• S2 citations—
• github stars17
• HF likes0
• heat score8.35
• arxiv keyzhang2024kp

Related papers

• U-RED: Unsupervised 3D Shape Retrieval And Deformation For Partial Point Clouds (2023)8.09
• Joint Learning Of 3D Shape Retrieval And Deformation (2021)11.08
• Improving The Matching Of Deformable Objects By Learning To Detect Keypoints (2023)7.74
• Enhancing Deformable Local Features By Jointly Learning To Detect And Describe Keypoints (2023)9.59
• End-to-end Learning Of Keypoint Detector And Descriptor For Pose Invariant 3D Matching (2018)12.40
• Patch2cad: Patchwise Embedding Learning For In-the-wild Shape Retrieval From A Single Image (2021)10.85
• Skeleton Merger: An Unsupervised Aligned Keypoint Detector (2021)15.68
• Deformation-aware 3D Model Embedding And Retrieval (2020)10.74