Instruct-reid++: Towards Universal Purpose Instruction-guided Person Re-identification

Abstract

Human intelligence can retrieve any person according to both visual and language descriptions. However, the current computer vision community studies specific person re-identification (ReID) tasks in different scenarios separately, which limits the applications in the real world. This paper strives to resolve this problem by proposing a novel instruct-ReID task that requires the model to retrieve images according to the given image or language instructions. Instruct-ReID is the first exploration of a general ReID setting, where existing 6 ReID tasks can be viewed as special cases by assigning different instructions. To facilitate research in this new instruct-ReID task, we propose a large-scale OmniReID++ benchmark equipped with diverse data and comprehensive evaluation methods e.g., task specific and task-free evaluation settings. In the task-specific evaluation setting, gallery sets are categorized according to specific ReID tasks. We propose a novel baseline model, IRM, with an adap

Stats

• citations3
• S2 citations—
• github stars201
• HF likes0
• heat score9.13
• arxiv keyhe2024instruct

Related papers

• Person Re-identification: Past, Present And Future (2016)0.00
• Human Re-id Meets Lvlms: What Can We Expect? (2025)2.26
• Video-based Visible-infrared Person Re-identification With Auxiliary Samples (2023)13.49
• Implicit Discriminative Knowledge Learning For Visible-infrared Person Re-identification (2024)16.19
• Mutual Information Guided Optimal Transport For Unsupervised Visible-infrared Person Re-identification (2024)0.00
• Learning Modal-invariant And Temporal-memory For Video-based Visible-infrared Person Re-identification (2022)14.23
• Bridging The Gap: Multi-level Cross-modality Joint Alignment For Visible-infrared Person Re-identification (2023)11.29
• All In One Framework For Multimodal Re-identification In The Wild (2024)10.35