Unbiased Evaluation Of Deep Metric Learning Algorithms

Abstract

Deep metric learning (DML) is a popular approach for images retrieval, solving verification (same or not) problems and addressing open set classification. Arguably, the most common DML approach is with triplet loss, despite significant advances in the area of DML. Triplet loss suffers from several issues such as collapse of the embeddings, high sensitivity to sampling schemes and more importantly a lack of performance when compared to more modern methods. We attribute this adoption to a lack of fair comparisons between various methods and the difficulty in adopting them for novel problem statements. In this paper, we perform an unbiased comparison of the most popular DML baseline methods under same conditions and more importantly, not obfuscating any hyper parameter tuning or adjustment needed to favor a particular method. We find, that under equal conditions several older methods perform significantly better than previously believed. In fact, our unified implementation of 12 recently

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfehervari2019unbiased

Related papers

• Revisiting Training Strategies And Generalization Performance In Deep Metric Learning (2020)5.08
• Ranked List Loss For Deep Metric Learning (2019)7.50
• Guided Deep Metric Learning (2022)6.77
• Improving Deep Metric Learning By Divide And Conquer (2021)8.09
• Directional Statistics-based Deep Metric Learning For Image Classification And Retrieval (2018)13.05
• Ensemble Of Loss Functions To Improve Generalizability Of Deep Metric Learning Methods (2021)7.16
• Multi-head Deep Metric Learning Using Global And Local Representations (2021)6.77
• Three Things To Know About Deep Metric Learning (2024)0.00