MAJL: A Model-agnostic Joint Learning Framework For Music Source Separation And Pitch Estimation

Abstract

Music source separation and pitch estimation are two vital tasks in music information retrieval. Typically, the input of pitch estimation is obtained from the output of music source separation. Therefore, existing methods have tried to perform these two tasks simultaneously, so as to leverage the mutually beneficial relationship between both tasks. However, these methods still face two critical challenges that limit the improvement of both tasks: the lack of labeled data and joint learning optimization. To address these challenges, we propose a Model-Agnostic Joint Learning (MAJL) framework for both tasks. MAJL is a generic framework and can use variant models for each task. It includes a two-stage training method and a dynamic weighting method named Dynamic Weights on Hard Samples (DWHS), which addresses the lack of labeled data and joint learning optimization, respectively. Experimental results on public music datasets show that MAJL outperforms state-of-the-art methods on both tasks

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keywei2025majl

Related papers

• DJCM: A Deep Joint Cascade Model For Singing Voice Separation And Vocal Pitch Estimation (2024)2.98
• JEPOO: Highly Accurate Joint Estimation Of Pitch, Onset And Offset For Music Information Retrieval (2023)6.34
• Deep-learning Architectures For Multi-pitch Estimation: Towards Reliable Evaluation (2022)0.00
• Unsupervised Music Source Separation Using Differentiable Parametric Source Models (2022)10.97
• Jointly Detecting And Separating Singing Voice: A Multi-task Approach (2018)7.81
• Adversarial Multi-task Learning For Disentangling Timbre And Pitch In Singing Voice Synthesis (2022)4.52
• Deep Domain Adaptation For Polyphonic Melody Extraction (2022)0.00
• Supervised Metric Learning For Music Structure Features (2021)0.00