Multi-domain Adaptation By Self-supervised Learning For Speaker Verification

Abstract

In real-world applications, speaker recognition models often face various domain-mismatch challenges, leading to a significant drop in performance. Although numerous domain adaptation techniques have been developed to address this issue, almost all present methods focus on a simple configuration where the model is trained in one domain and deployed in another. However, real-world environments are often complex and may contain multiple domains, making the methods designed for one-to-one adaptation suboptimal. In our paper, we propose a self-supervised learning method to tackle this multi-domain adaptation problem. Building upon the basic self-supervised adaptation algorithm, we designed three strategies to make it suitable for multi-domain adaptation: an in-domain negative sampling strategy, a MoCo-like memory bank scheme, and a CORAL-like distribution alignment. We conducted experiments using VoxCeleb2 as the source domain dataset and CN-Celeb1 as the target multi-domain dataset. Our r

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keylin2023multi

Related papers

• Self-supervised Learning Based Domain Adaptation For Robust Speaker Verification (2021)11.49
• Adversarial Training For Multi-domain Speaker Recognition (2020)6.77
• Cross-domain Adaptation With Discrepancy Minimization For Text-independent Forensic Speaker Verification (2020)8.60
• Speaker Verification Using End-to-end Adversarial Language Adaptation (2018)11.19
• Vae-based Domain Adaptation For Speaker Verification (2019)7.50
• Automatic Data Augmentation For Domain Adapted Fine-tuning Of Self-supervised Speech Representations (2023)0.00
• Source -free Domain Adaptation For Speaker Verification In Data-scarce Languages And Noisy Channels (2024)0.00
• Editnet: A Lightweight Network For Unsupervised Domain Adaptation In Speaker Verification (2022)5.84