DH3D: Deep Hierarchical 3D Descriptors For Robust Large-scale 6dof Relocalization

Abstract

For relocalization in large-scale point clouds, we propose the first approach that unifies global place recognition and local 6DoF pose refinement. To this end, we design a Siamese network that jointly learns 3D local feature detection and description directly from raw 3D points. It integrates FlexConv and Squeeze-and-Excitation (SE) to assure that the learned local descriptor captures multi-level geometric information and channel-wise relations. For detecting 3D keypoints we predict the discriminativeness of the local descriptors in an unsupervised manner. We generate the global descriptor by directly aggregating the learned local descriptors with an effective attention mechanism. In this way, local and global 3D descriptors are inferred in one single forward pass. Experiments on various benchmarks demonstrate that our method achieves competitive results for both global point cloud retrieval and local point cloud registration in comparison to state-of-the-art approaches. To validate t

Stats

• citations92
• S2 citations—
• github stars0
• HF likes0
• heat score14.76
• arxiv keydu2020dh3d

Related papers

• Logg3d-net: Locally Guided Global Descriptor Learning For 3D Place Recognition (2021)19.02
• Deeppoint3d: Learning Discriminative Local Descriptors Using Deep Metric Learning On 3D Point Clouds (2019)9.59
• Leveraging Local And Global Descriptors In Parallel To Search Correspondences For Visual Localization (2020)8.82
• Lpd-net: 3D Point Cloud Learning For Large-scale Place Recognition And Environment Analysis (2018)18.40
• Pointnetvlad: Deep Point Cloud Based Retrieval For Large-scale Place Recognition (2018)25.45
• End-to-end Learning Of Keypoint Detector And Descriptor For Pose Invariant 3D Matching (2018)12.40
• Learning Local Descriptors By Optimizing The Keypoint-correspondence Criterion: Applications To Face Matching, Learning From Unlabeled Videos And 3d-shape Retrieval (2016)11.75
• Efficient 3D Point Cloud Feature Learning For Large-scale Place Recognition (2021)14.73