Cross-domain Image Retrieval With Attention Modeling

Abstract

With the proliferation of e-commerce websites and the ubiquitousness of smart phones, cross-domain image retrieval using images taken by smart phones as queries to search products on e-commerce websites is emerging as a popular application. One challenge of this task is to locate the attention of both the query and database images. In particular, database images, e.g. of fashion products, on e-commerce websites are typically displayed with other accessories, and the images taken by users contain noisy background and large variations in orientation and lighting. Consequently, their attention is difficult to locate. In this paper, we exploit the rich tag information available on the e-commerce websites to locate the attention of database images. For query images, we use each candidate image in the database as the context to locate the query attention. Novel deep convolutional neural network architectures, namely TagYNet and CtxYNet, are proposed to learn the attention weights and then ex

Stats

• citations67
• S2 citations—
• github stars0
• HF likes0
• heat score13.74
• arxiv keyji2017cross

Related papers

• Clothing Retrieval With Visual Attention Model (2017)12.10
• Where To Look And How To Describe: Fashion Image Retrieval With An Attentional Heterogeneous Bilinear Network (2020)11.19
• Image Search With Text Feedback By Additive Attention Compositional Learning (2022)0.00
• Search By Image: Deeply Exploring Beneficial Features For Beauty Product Retrieval (2023)0.00
• Snap And Find: Deep Discrete Cross-domain Garment Image Retrieval (2019)0.00
• AMC: Attention Guided Multi-modal Correlation Learning For Image Search (2017)10.97
• All The Attention You Need: Global-local, Spatial-channel Attention For Image Retrieval (2021)13.97
• Training And Challenging Models For Text-guided Fashion Image Retrieval (2022)0.00