Triplet Synthesis For Enhancing Composed Image Retrieval Via Counterfactual Image Generation

Abstract

Composed Image Retrieval (CIR) provides an effective way to manage and access large-scale visual data. Construction of the CIR model utilizes triplets that consist of a reference image, modification text describing desired changes, and a target image that reflects these changes. For effectively training CIR models, extensive manual annotation to construct high-quality training datasets, which can be time-consuming and labor-intensive, is required. To deal with this problem, this paper proposes a novel triplet synthesis method by leveraging counterfactual image generation. By controlling visual feature modifications via counterfactual image generation, our approach automatically generates diverse training triplets without any manual intervention. This approach facilitates the creation of larger and more expressive datasets, leading to the improvement of CIR model's performance.

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keyuesugi2025triplet

Related papers

• Automatic Synthesis Of High-quality Triplet Data For Composed Image Retrieval (2025)0.00
• Scale Up Composed Image Retrieval Learning Via Modification Text Generation (2025)3.58
• Pseudo-triplet Guided Few-shot Composed Image Retrieval (2024)0.00
• Good4cir: Generating Detailed Synthetic Captions For Composed Image Retrieval (2025)0.00
• Improving Composed Image Retrieval Via Contrastive Learning With Scaling Positives And Negatives (2024)11.30
• Scaling Prompt Instructed Zero Shot Composed Image Retrieval With Image-only Data (2025)0.00
• Visual Delta Generator With Large Multi-modal Models For Semi-supervised Composed Image Retrieval (2024)9.03
• From Mapping To Composing: A Two-stage Framework For Zero-shot Composed Image Retrieval (2025)0.00