Progressive Feature Mining And External Knowledge-assisted Text-pedestrian Image Retrieval

Abstract

Text-Pedestrian Image Retrieval aims to use the text describing pedestrian appearance to retrieve the corresponding pedestrian image. This task involves not only modality discrepancy, but also the challenge of the textual diversity of pedestrians with the same identity. At present, although existing research progress has been made in text-pedestrian image retrieval, these methods do not comprehensively consider the above-mentioned problems. Considering these, this paper proposes a progressive feature mining and external knowledge-assisted feature purification method. Specifically, we use a progressive mining mode to enable the model to mine discriminative features from neglected information, thereby avoiding the loss of discriminative information and improving the expression ability of features. In addition, to further reduce the negative impact of modal discrepancy and text diversity on cross-modal matching, we propose to use other sample knowledge of the same modality, i.e., external

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keyli2023progressive

Related papers

• Enhancing Visual Representation For Text-based Person Searching (2024)1.69
• Person Text-image Matching Via Text-feature Interpretability Embedding And External Attack Node Implantation (2022)7.16
• The Solution For The CVPR 2023 1st Foundation Model Challenge-track2 (2024)0.00
• Multi-path Exploration And Feedback Adjustment For Text-to-image Person Retrieval (2024)0.00
• Fine-grained Image Classification And Retrieval By Combining Visual And Locally Pooled Textual Features (2020)10.48
• Progressive Learning For Image Retrieval With Hybrid-modality Queries (2022)10.97
• Enhancing Image-text Matching With Adaptive Feature Aggregation (2024)6.34
• Efficient Image-text Retrieval Via Keyword-guided Pre-screening (2023)5.84