Localizing And Orienting Street Views Using Overhead Imagery

Abstract

In this paper we aim to determine the location and orientation of a ground-level query image by matching to a reference database of overhead (e.g. satellite) images. For this task we collect a new dataset with one million pairs of street view and overhead images sampled from eleven U.S. cities. We explore several deep CNN architectures for cross-domain matching -- Classification, Hybrid, Siamese, and Triplet networks. Classification and Hybrid architectures are accurate but slow since they allow only partial feature precomputation. We propose a new loss function which significantly improves the accuracy of Siamese and Triplet embedding networks while maintaining their applicability to large-scale retrieval tasks like image geolocalization. This image matching task is challenging not just because of the dramatic viewpoint difference between ground-level and overhead imagery but because the orientation (i.e. azimuth) of the street views is unknown making correspondence even more difficul

Stats

• citations199
• S2 citations—
• github stars0
• HF likes0
• heat score17.26
• arxiv keyvo2016localizing

Related papers

• Cross-view Image Matching For Geo-localization In Urban Environments (2017)17.16
• VICI: Vlm-instructed Cross-view Image-localisation (2025)2.51
• From Street To Orbit: Training-free Cross-view Retrieval Via Location Semantics And LLM Guidance (2025)0.00
• Coming Down To Earth: Satellite-to-street View Synthesis For Geo-localization (2021)16.28
• Multiview Image-based Localization (2025)0.00
• VIGOR: Cross-view Image Geo-localization Beyond One-to-one Retrieval (2020)21.49
• Geo-localization Via Ground-to-satellite Cross-view Image Retrieval (2022)12.54
• Sparse-to-dense Hypercolumn Matching For Long-term Visual Localization (2019)12.99