Efficient Discovery And Effective Evaluation Of Visual Perceptual Similarity: A Benchmark And Beyond

Abstract

Visual similarities discovery (VSD) is an important task with broad e-commerce applications. Given an image of a certain object, the goal of VSD is to retrieve images of different objects with high perceptual visual similarity. Although being a highly addressed problem, the evaluation of proposed methods for VSD is often based on a proxy of an identification-retrieval task, evaluating the ability of a model to retrieve different images of the same object. We posit that evaluating VSD methods based on identification tasks is limited, and faithful evaluation must rely on expert annotations. In this paper, we introduce the first large-scale fashion visual similarity benchmark dataset, consisting of more than 110K expert-annotated image pairs. Besides this major contribution, we share insight from the challenges we faced while curating this dataset. Based on these insights, we propose a novel and efficient labeling procedure that can be applied to any dataset. Our analysis examines its lim

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keybarkan2023efficient

Related papers

• Lrvs-fashion: Extending Visual Search With Referring Instructions (2023)0.00
• Needle In A Haystack, Fast: Benchmarking Image Perceptual Similarity Metrics At Scale (2022)0.00
• Visual Product Search Benchmark (2026)0.00
• Dataset And Case Studies For Visual Near-duplicates Detection In The Context Of Social Media (2022)0.00
• Visually Similar Products Retrieval For Shopsy (2022)2.26
• Dreamsim: Learning New Dimensions Of Human Visual Similarity Using Synthetic Data (2023)5.84
• Lookbench: A Live And Holistic Open Benchmark For Fashion Image Retrieval (2026)0.00
• Contextual Visual Similarity (2016)0.00