Self-supervised Auxiliary Loss For Metric Learning In Music Similarity-based Retrieval And Auto-tagging

Abstract

In the realm of music information retrieval, similarity-based retrieval and auto-tagging serve as essential components. Given the limitations and non-scalability of human supervision signals, it becomes crucial for models to learn from alternative sources to enhance their performance. Self-supervised learning, which exclusively relies on learning signals derived from music audio data, has demonstrated its efficacy in the context of auto-tagging. In this study, we propose a model that builds on the self-supervised learning approach to address the similarity-based retrieval challenge by introducing our method of metric learning with a self-supervised auxiliary loss. Furthermore, diverging from conventional self-supervised learning methodologies, we discovered the advantages of concurrently training the model with both self-supervision and supervision signals, without freezing pre-trained models. We also found that refraining from employing augmentation during the fine-tuning phase yields

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyakama2023self

Related papers

• Multimodal Metric Learning For Tag-based Music Retrieval (2020)9.76
• Disentangled Multidimensional Metric Learning For Music Similarity (2020)10.61
• Self-supervised Contrastive Learning For Robust Audio-sheet Music Retrieval Systems (2023)5.24
• Anchor-aware Deep Metric Learning For Audio-visual Retrieval (2024)6.34
• Musical Audio Similarity With Self-supervised Convolutional Neural Networks (2022)0.00
• Self-taught Metric Learning Without Labels (2022)9.41
• Metric Learning Vs Classification For Disentangled Music Representation Learning (2020)0.00
• Metric Learning By Similarity Network For Deep Semi-supervised Learning (2020)3.58