Multi-objective Progressive Clustering For Semi-supervised Domain Adaptation In Speaker Verification

Abstract

Utilizing the pseudo-labeling algorithm with large-scale unlabeled data becomes crucial for semi-supervised domain adaptation in speaker verification tasks. In this paper, we propose a novel pseudo-labeling method named Multi-objective Progressive Clustering (MoPC), specifically designed for semi-supervised domain adaptation. Firstly, we utilize limited labeled data from the target domain to derive domain-specific descriptors based on multiple distinct objectives, namely within-graph denoising, intra-class denoising and inter-class denoising. Then, the Infomap algorithm is adopted for embedding clustering, and the descriptors are leveraged to further refine the target domain's pseudo-labels. Moreover, to further improve the quality of pseudo labels, we introduce the subcenter-purification and progressive-merging strategy for label denoising. Our proposed MoPC method achieves 4.95% EER and ranked the 1\(^\{st\}\) place on the evaluation set of VoxSRC 2023 track 3. We also conduct additi

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keyli2023multi

Related papers

• Progressive Sub-graph Clustering Algorithm For Semi-supervised Domain Adaptation Speaker Verification (2023)0.00
• Multi-domain Adaptation By Self-supervised Learning For Speaker Verification (2023)0.00
• Channel Adaptation For Speaker Verification Using Optimal Transport With Pseudo Label (2024)0.00
• Prototype And Instance Contrastive Learning For Unsupervised Domain Adaptation In Speaker Verification (2024)0.00
• Self-supervised Learning Based Domain Adaptation For Robust Speaker Verification (2021)11.49
• Semi-supervised Training With Pseudo-labeling For End-to-end Neural Diarization (2021)0.00
• Self-supervised Text-independent Speaker Verification Using Prototypical Momentum Contrastive Learning (2020)12.93
• Adversarial Training For Multi-domain Speaker Recognition (2020)6.77