Metasid: Singer Identification With Domain Adaptation For Metaverse

Abstract

Metaverse has stretched the real world into unlimited space. There will be more live concerts in Metaverse. The task of singer identification is to identify the song belongs to which singer. However, there has been a tough problem in singer identification, which is the different live effects. The studio version is different from the live version, the data distribution of the training set and the test set are different, and the performance of the classifier decreases. This paper proposes the use of the domain adaptation method to solve the live effect in singer identification. Three methods of domain adaptation combined with Convolutional Recurrent Neural Network (CRNN) are designed, which are Maximum Mean Discrepancy (MMD), gradient reversal (Revgrad), and Contrastive Adaptation Network (CAN). MMD is a distance-based method, which adds domain loss. Revgrad is based on the idea that learned features can represent different domain samples. CAN is based on class adaptation, it takes into

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keyzhang2022metasid

Related papers

• MDCNN-SID: Multi-scale Dilated Convolution Network For Singer Identification (2020)5.24
• Change Your Singer: A Transfer Learning Generative Adversarial Framework For Song To Song Conversion (2019)0.00
• Multi-domain Adaptation By Self-supervised Learning For Speaker Verification (2023)0.00
• Deep Domain Adaptation For Polyphonic Melody Extraction (2022)0.00
• Multi-singer: Fast Multi-singer Singing Voice Vocoder With A Large-scale Corpus (2021)13.28
• Primadnn': A Characteristics-aware DNN Customization For Singing Technique Detection (2023)0.00
• Domain-invariant Speaker Vector Projection By Model-agnostic Meta-learning (2020)8.82
• Singing Voice Conversion With Disentangled Representations Of Singer And Vocal Technique Using Variational Autoencoders (2019)10.97