Language Guided Local Infiltration For Interactive Image Retrieval

Abstract

Interactive Image Retrieval (IIR) aims to retrieve images that are generally similar to the reference image but under the requested text modification. The existing methods usually concatenate or sum the features of image and text simply and roughly, which, however, is difficult to precisely change the local semantics of the image that the text intends to modify. To solve this problem, we propose a Language Guided Local Infiltration (LGLI) system, which fully utilizes the text information and penetrates text features into image features as much as possible. Specifically, we first propose a Language Prompt Visual Localization (LPVL) module to generate a localization mask which explicitly locates the region (semantics) intended to be modified. Then we introduce a Text Infiltration with Local Awareness (TILA) module, which is deployed in the network to precisely modify the reference image and generate image-text infiltrated representation. Extensive experiments on various benchmark databas

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keyhuang2023language

Related papers

• Interactive Text-to-image Retrieval With Large Language Models: A Plug-and-play Approach (2024)10.24
• ELIP: Enhanced Visual-language Foundation Models For Image Retrieval (2025)2.26
• Lexlip: Lexicon-bottlenecked Language-image Pre-training For Large-scale Image-text Retrieval (2023)10.85
• Hivlp: Hierarchical Vision-language Pre-training For Fast Image-text Retrieval (2022)0.00
• Text-guided Image Restoration And Semantic Enhancement For Text-to-image Person Retrieval (2023)9.00
• FLAIR: VLM With Fine-grained Language-informed Image Representations (2024)10.14
• Scaling Prompt Instructed Zero Shot Composed Image Retrieval With Image-only Data (2025)0.00
• Enhancing Interactive Image Retrieval With Query Rewriting Using Large Language Models And Vision Language Models (2024)8.82