Pit30m: A Benchmark For Global Localization In The Age Of Self-driving Cars

Abstract

We are interested in understanding whether retrieval-based localization approaches are good enough in the context of self-driving vehicles. Towards this goal, we introduce Pit30M, a new image and LiDAR dataset with over 30 million frames, which is 10 to 100 times larger than those used in previous work. Pit30M is captured under diverse conditions (i.e., season, weather, time of the day, traffic), and provides accurate localization ground truth. We also automatically annotate our dataset with historical weather and astronomical data, as well as with image and LiDAR semantic segmentation as a proxy measure for occlusion. We benchmark multiple existing methods for image and LiDAR retrieval and, in the process, introduce a simple, yet effective convolutional network-based LiDAR retrieval method that is competitive with the state of the art. Our work provides, for the first time, a benchmark for sub-metre retrieval-based localization at city scale. The dataset, its Python SDK, as well as mo

Stats

• citations8
• S2 citations—
• github stars0
• HF likes0
• heat score7.16
• arxiv keymartinez2020pit30m

Related papers

• Investigating The Role Of Image Retrieval For Visual Localization -- An Exhaustive Benchmark (2022)16.58
• Benchmarking Image Retrieval For Visual Localization (2020)17.78
• Improving Nighttime Retrieval-based Localization (2018)0.00
• DASGIL: Domain Adaptation For Semantic And Geometric-aware Image-based Localization (2020)13.11
• Game4loc: A UAV Geo-localization Benchmark From Game Data (2024)9.59
• Deep Dense Local Feature Matching And Vehicle Removal For Indoor Visual Localization (2022)0.00
• Learning Condition Invariant Features For Retrieval-based Localization From 1M Images (2020)0.00
• Localizing And Orienting Street Views Using Overhead Imagery (2016)17.26