Bridging The Gap: Multi-level Cross-modality Joint Alignment For Visible-infrared Person Re-identification
2023 · Tengfei Liang, Yi Jin, Wu Liu, et al.
Abstract
Visible-Infrared person Re-IDentification (VI-ReID) is a challenging cross-modality image retrieval task that aims to match pedestrians' images across visible and infrared cameras. To solve the modality gap, existing mainstream methods adopt a learning paradigm converting the image retrieval task into an image classification task with cross-entropy loss and auxiliary metric learning losses. These losses follow the strategy of adjusting the distribution of extracted embeddings to reduce the intra-class distance and increase the inter-class distance. However, such objectives do not precisely correspond to the final test setting of the retrieval task, resulting in a new gap at the optimization level. By rethinking these keys of VI-ReID, we propose a simple and effective method, the Multi-level Cross-modality Joint Alignment (MCJA), bridging both modality and objective-level gap. For the former, we design the Modality Alignment Augmentation, which consists of three novel strategies, the we
Authors
(none)
Tags
Stats
Related papers
- Bridging The Distribution Gap Of Visible-infrared Person Re-identification With Modality Batch Normalization (2021)8.60
- Implicit Discriminative Knowledge Learning For Visible-infrared Person Re-identification (2024)16.19
- Mix-modality Person Re-identification: A New And Practical Paradigm (2024)6.34
- BIT: Matching-based Bi-directional Interaction Transformation Network For Visible-infrared Person Re-identification (2026)0.00
- Dynamic Dual-attentive Aggregation Learning For Visible-infrared Person Re-identification (2020)19.67
- Unified Batch All Triplet Loss For Visible-infrared Person Re-identification (2021)9.03
- Mutual Information Guided Optimal Transport For Unsupervised Visible-infrared Person Re-identification (2024)0.00
- Video-based Visible-infrared Person Re-identification With Auxiliary Samples (2023)13.49