Contextual Visual Similarity

Abstract

Measuring visual similarity is critical for image understanding. But what makes two images similar? Most existing work on visual similarity assumes that images are similar because they contain the same object instance or category. However, the reason why images are similar is much more complex. For example, from the perspective of category, a black dog image is similar to a white dog image. However, in terms of color, a black dog image is more similar to a black horse image than the white dog image. This example serves to illustrate that visual similarity is ambiguous but can be made precise when given an explicit contextual perspective. Based on this observation, we propose the concept of contextual visual similarity. To be concrete, we examine the concept of contextual visual similarity in the application domain of image search. Instead of providing only a single image for image similarity search (\eg, Google image search), we require three images. Given a query image, a second posit

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2016contextual

Related papers

• Visual Re-ranking With Non-visual Side Information (2025)0.00
• Visual Similarity Attention (2019)0.00
• Contextual Similarity Aggregation With Self-attention For Visual Re-ranking (2021)0.00
• Learning Non-metric Visual Similarity For Image Retrieval (2017)11.58
• Conditional Similarity Networks (2016)15.06
• Efficient Discovery And Effective Evaluation Of Visual Perceptual Similarity: A Benchmark And Beyond (2023)4.52
• Image Similarity Using An Ensemble Of Context-sensitive Models (2024)4.52
• Cross-media Similarity Evaluation For Web Image Retrieval In The Wild (2017)9.59