Rendernet: Visual Relocalization Using Virtual Viewpoints In Large-scale Indoor Environments

Abstract

Visual relocalization has been a widely discussed problem in 3D vision: given a pre-constructed 3D visual map, the 6 DoF (Degrees-of-Freedom) pose of a query image is estimated. Relocalization in large-scale indoor environments enables attractive applications such as augmented reality and robot navigation. However, appearance changes fast in such environments when the camera moves, which is challenging for the relocalization system. To address this problem, we propose a virtual view synthesis-based approach, RenderNet, to enrich the database and refine poses regarding this particular scenario. Instead of rendering real images which requires high-quality 3D models, we opt to directly render the needed global and local features of virtual viewpoints and apply them in the subsequent image retrieval and feature matching operations respectively. The proposed method can largely improve the performance in large-scale indoor environments, e.g., achieving an improvement of 7.1% and 12.2% on the

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyzhang2022rendernet

Related papers

• Visible Structure Retrieval For Lightweight Image-based Relocalisation (2025)0.00
• Retrieval And Localization With Observation Constraints (2021)5.24
• Multiview Image-based Localization (2025)0.00
• Multires-netvlad: Augmenting Place Recognition Training With Low-resolution Imagery (2022)16.01
• Eigenplaces: Training Viewpoint Robust Models For Visual Place Recognition (2023)15.46
• Meshvpr: Citywide Visual Place Recognition Using 3D Meshes (2024)6.77
• Are Local Features All You Need For Cross-domain Visual Place Recognition? (2023)13.80
• Yes, We CANN: Constrained Approximate Nearest Neighbors For Local Feature-based Visual Localization (2023)14.99