On-the-fly Sfm: What You Capture Is What You Get

Abstract

Over the last decades, ample achievements have been made on Structure from motion (SfM). However, the vast majority of them basically work in an offline manner, i.e., images are firstly captured and then fed together into a SfM pipeline for obtaining poses and sparse point cloud. In this work, on the contrary, we present an on-the-fly SfM: running online SfM while image capturing, the newly taken On-the-Fly image is online estimated with the corresponding pose and points, i.e., what you capture is what you get. Specifically, our approach firstly employs a vocabulary tree that is unsupervised trained using learning-based global features for fast image retrieval of newly fly-in image. Then, a robust feature matching mechanism with least squares (LSM) is presented to improve image registration performance. Finally, via investigating the influence of newly fly-in image's connected neighboring images, an efficient hierarchical weighted local bundle adjustment (BA) is used for optimization.

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keyzhan2023on

Related papers

• Efficient Match Pair Retrieval For Large-scale UAV Images Via Graph Indexed Global Descriptor (2023)6.77
• Supscene: Scene-structured Overlap Supervision For Image Retrieval In Unconstrained Sfm (2026)2.20
• A Scene Is Worth A Thousand Features: Feed-forward Camera Localization From A Collection Of Image Features (2025)0.00
• From Street To Orbit: Training-free Cross-view Retrieval Via Location Semantics And LLM Guidance (2025)0.00
• Image Retrieval For Structure-from-motion Via Graph Convolutional Network (2020)9.59
• CORSAIR: Convolutional Object Retrieval And Symmetry-aided Registration (2021)6.77
• Location Field Descriptors: Single Image 3D Model Retrieval In The Wild (2019)11.39
• Visible Structure Retrieval For Lightweight Image-based Relocalisation (2025)0.00