Robohop: Segment-based Topological Map Representation For Open-world Visual Navigation

Abstract

Mapping is crucial for spatial reasoning, planning and robot navigation. Existing approaches range from metric, which require precise geometry-based optimization, to purely topological, where image-as-node based graphs lack explicit object-level reasoning and interconnectivity. In this paper, we propose a novel topological representation of an environment based on "image segments", which are semantically meaningful and open-vocabulary queryable, conferring several advantages over previous works based on pixel-level features. Unlike 3D scene graphs, we create a purely topological graph with segments as nodes, where edges are formed by a) associating segment-level descriptors between pairs of consecutive images and b) connecting neighboring segments within an image using their pixel centroids. This unveils a "continuous sense of a place", defined by inter-image persistence of segments along with their intra-image neighbours. It further enables us to represent and update segment-level des

Stats

• citations19
• S2 citations—
• github stars0
• HF likes0
• heat score9.76
• arxiv keygarg2024robohop

Related papers

• Mapping, Localization And Path Planning For Image-based Navigation Using Visual Features And Map (2018)11.93
• Revisit Anything: Visual Place Recognition Via Image Segment Retrieval (2024)13.05
• Pix2map: Cross-modal Retrieval For Inferring Street Maps From Images (2023)5.84
• Open-world 3D Scene Graph Generation For Retrieval-augmented Reasoning (2025)0.00
• Graph-based Non-linear Least Squares Optimization For Visual Place Recognition In Changing Environments (2020)7.16
• Rendernet: Visual Relocalization Using Virtual Viewpoints In Large-scale Indoor Environments (2022)0.00
• One-shot Informed Robotic Visual Search In The Wild (2020)7.81
• Hpointloc: Point-based Indoor Place Recognition Using Synthetic RGB-D Images (2022)10.66