DASGIL: Domain Adaptation For Semantic And Geometric-aware Image-based Localization

Abstract

Long-Term visual localization under changing environments is a challenging problem in autonomous driving and mobile robotics due to season, illumination variance, etc. Image retrieval for localization is an efficient and effective solution to the problem. In this paper, we propose a novel multi-task architecture to fuse the geometric and semantic information into the multi-scale latent embedding representation for visual place recognition. To use the high-quality ground truths without any human effort, the effective multi-scale feature discriminator is proposed for adversarial training to achieve the domain adaptation from synthetic virtual KITTI dataset to real-world KITTI dataset. The proposed approach is validated on the Extended CMU-Seasons dataset and Oxford RobotCar dataset through a series of crucial comparison experiments, where our performance outperforms state-of-the-art baselines for retrieval-based localization and large-scale place recognition under the challenging environ

Stats

• citations55
• S2 citations—
• github stars0
• HF likes0
• heat score13.11
• arxiv keyhu2020dasgil

Related papers

• Adversarial Training For Adverse Conditions: Robust Metric Localisation Using Appearance Transfer (2018)14.43
• Domain-invariant Similarity Activation Map Contrastive Learning For Retrieval-based Long-term Visual Localization (2020)13.72
• Training Semantic Descriptors For Image-based Localization (2022)0.00
• Retrieval-based Localization Based On Domain-invariant Feature Learning Under Changing Environments (2019)9.92
• Improving Nighttime Retrieval-based Localization (2018)0.00
• Semantic Pose Verification For Outdoor Visual Localization With Self-supervised Contrastive Learning (2022)8.35
• Semantic Signatures For Large-scale Visual Localization (2020)5.24
• Deep Dense Local Feature Matching And Vehicle Removal For Indoor Visual Localization (2022)0.00