Retrieval Guided Unsupervised Multi-domain Image-to-image Translation

Abstract

Image to image translation aims to learn a mapping that transforms an image from one visual domain to another. Recent works assume that images descriptors can be disentangled into a domain-invariant content representation and a domain-specific style representation. Thus, translation models seek to preserve the content of source images while changing the style to a target visual domain. However, synthesizing new images is extremely challenging especially in multi-domain translations, as the network has to compose content and style to generate reliable and diverse images in multiple domains. In this paper we propose the use of an image retrieval system to assist the image-to-image translation task. First, we train an image-to-image translation model to map images to multiple domains. Then, we train an image retrieval model using real and generated images to find images similar to a query one in content but in a different domain. Finally, we exploit the image retrieval system to fine-tune

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keygomez2020retrieval

Related papers

• Image-to-image Translation For Cross-domain Disentanglement (2018)0.00
• Syncdr : Training Cross Domain Retrieval Models With Synthetic Data (2023)0.00
• Night-to-day Image Translation For Retrieval-based Localization (2018)16.88
• Universal Model For Multi-domain Medical Image Retrieval (2020)0.00
• Feature Representation Learning For Unsupervised Cross-domain Image Retrieval (2022)11.46
• Retrieval-guided Cross-view Image Synthesis (2024)0.00
• Test-time Training For Data-efficient UCDR (2022)0.00
• DUDE: Diffusion-based Unsupervised Cross-domain Image Retrieval (2025)0.00