Up-person: Unified Parameter-efficient Transfer Learning For Text-based Person Retrieval

Abstract

Text-based Person Retrieval (TPR) as a multi-modal task, which aims to retrieve the target person from a pool of candidate images given a text description, has recently garnered considerable attention due to the progress of contrastive visual-language pre-trained model. Prior works leverage pre-trained CLIP to extract person visual and textual features and fully fine-tune the entire network, which have shown notable performance improvements compared to uni-modal pre-training models. However, full-tuning a large model is prone to overfitting and hinders the generalization ability. In this paper, we propose a novel Unified Parameter-Efficient Transfer Learning (PETL) method for Text-based Person Retrieval (UP-Person) to thoroughly transfer the multi-modal knowledge from CLIP. Specifically, UP-Person simultaneously integrates three lightweight PETL components including Prefix, LoRA and Adapter, where Prefix and LoRA are devised together to mine local information with task-specific informa

Stats

• citations1
• S2 citations—
• github stars9
• HF likes0
• heat score4.26
• arxiv keyliu2025up

Related papers

• CPCL: Cross-modal Prototypical Contrastive Learning For Weakly Supervised Text-based Person Retrieval (2024)0.00
• Text-guided Image Restoration And Semantic Enhancement For Text-to-image Person Retrieval (2023)9.00
• Beat: Bi-directional One-to-many Embedding Alignment For Text-based Person Retrieval (2024)10.85
• TIPCB: A Simple But Effective Part-based Convolutional Baseline For Text-based Person Search (2021)20.24
• Enhancing Visual Representation For Text-based Person Searching (2024)1.69
• Cross-modal Full-mode Fine-grained Alignment For Text-to-image Person Retrieval (2025)2.23
• Text-based Person Search With Limited Data (2021)15.69
• Contrastive Transformer Learning With Proximity Data Generation For Text-based Person Search (2023)11.88