Imagine And Seek: Improving Composed Image Retrieval With An Imagined Proxy

Abstract

The Zero-shot Composed Image Retrieval (ZSCIR) requires retrieving images that match the query image and the relative captions. Current methods focus on projecting the query image into the text feature space, subsequently combining them with features of query texts for retrieval. However, retrieving images only with the text features cannot guarantee detailed alignment due to the natural gap between images and text. In this paper, we introduce Imagined Proxy for CIR (IP-CIR), a training-free method that creates a proxy image aligned with the query image and text description, enhancing query representation in the retrieval process. We first leverage the large language model's generalization capability to generate an image layout, and then apply both the query text and image for conditional generation. The robust query features are enhanced by merging the proxy image, query image, and text semantic perturbation. Our newly proposed balancing metric integrates text-based and proxy retrieva

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keyli2024imagine

Related papers

• From Mapping To Composing: A Two-stage Framework For Zero-shot Composed Image Retrieval (2025)0.00
• Isearle: Improving Textual Inversion For Zero-shot Composed Image Retrieval (2024)12.09
• Zero-shot Composed Image Retrieval With Textual Inversion (2023)19.84
• Fine-grained Zero-shot Composed Image Retrieval With Complementary Visual-semantic Integration (2026)1.24
• Multimodal Reasoning Agent For Zero-shot Composed Image Retrieval (2025)0.00
• Hycir: Boosting Zero-shot Composed Image Retrieval With Synthetic Labels (2024)0.00
• WISER: Wider Search, Deeper Thinking, And Adaptive Fusion For Training-free Zero-shot Composed Image Retrieval (2026)2.98
• Zero Shot Composed Image Retrieval (2025)1.57