Semi-supervised Text-based Person Search

Abstract

Text-based person search (TBPS) aims to retrieve images of a specific person from a large image gallery based on a natural language description. Existing methods rely on massive annotated image-text data to achieve satisfactory performance in fully-supervised learning. It poses a significant challenge in practice, as acquiring person images from surveillance videos is relatively easy, while obtaining annotated texts is challenging. The paper undertakes a pioneering initiative to explore TBPS under the semi-supervised setting, where only a limited number of person images are annotated with textual descriptions while the majority of images lack annotations. We present a two-stage basic solution based on generation-then-retrieval for semi-supervised TBPS. The generation stage enriches annotated data by applying an image captioning model to generate pseudo-texts for unannotated images. Later, the retrieval stage performs fully-supervised retrieval learning using the augmented data. Signifi

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keygao2024semi

Related papers

• Text-based Person Search With Limited Data (2021)15.69
• Contrastive Transformer Learning With Proximity Data Generation For Text-based Person Search (2023)11.88
• Boosting Weak Positives For Text Based Person Search (2025)0.00
• TIPCB: A Simple But Effective Part-based Convolutional Baseline For Text-based Person Search (2021)20.24
• Enhancing Visual Representation For Text-based Person Searching (2024)1.69
• Sa-person: Text-based Person Retrieval With Scene-aware Re-ranking (2025)0.00
• Text-guided Image Restoration And Semantic Enhancement For Text-to-image Person Retrieval (2023)9.00
• Person Retrieval In Surveillance Using Textual Query: A Review (2021)0.00