Enhancing Deformable Local Features By Jointly Learning To Detect And Describe Keypoints

Abstract

Local feature extraction is a standard approach in computer vision for tackling important tasks such as image matching and retrieval. The core assumption of most methods is that images undergo affine transformations, disregarding more complicated effects such as non-rigid deformations. Furthermore, incipient works tailored for non-rigid correspondence still rely on keypoint detectors designed for rigid transformations, hindering performance due to the limitations of the detector. We propose DALF (Deformation-Aware Local Features), a novel deformation-aware network for jointly detecting and describing keypoints, to handle the challenging problem of matching deformable surfaces. All network components work cooperatively through a feature fusion approach that enforces the descriptors' distinctiveness and invariance. Experiments using real deforming objects showcase the superiority of our method, where it delivers 8% improvement in matching scores compared to the previous best results. Our

Stats

• citations18
• S2 citations—
• github stars0
• HF likes0
• heat score9.59
• arxiv keypotje2023enhancing

Related papers

• Improving The Matching Of Deformable Objects By Learning To Detect Keypoints (2023)7.74
• Learning Local Descriptors By Optimizing The Keypoint-correspondence Criterion: Applications To Face Matching, Learning From Unlabeled Videos And 3d-shape Retrieval (2016)11.75
• Local Feature Matching Using Deep Learning: A Survey (2024)18.68
• KP-RED: Exploiting Semantic Keypoints For Joint 3D Shape Retrieval And Deformation (2024)8.35
• Joint Learning Of 3D Shape Retrieval And Deformation (2021)11.08
• Leveraging Local And Global Descriptors In Parallel To Search Correspondences For Visual Localization (2020)8.82
• DH3D: Deep Hierarchical 3D Descriptors For Robust Large-scale 6dof Relocalization (2020)14.76
• Large-scale Image Retrieval With Attentive Deep Local Features (2016)30.63