Prototype And Instance Contrastive Learning For Unsupervised Domain Adaptation In Speaker Verification

Abstract

Speaker verification system trained on one domain usually suffers performance degradation when applied to another domain. To address this challenge, researchers commonly use feature distribution matching-based methods in unsupervised domain adaptation scenarios where some unlabeled target domain data is available. However, these methods often have limited performance improvement and lack generalization in various mismatch situations. In this paper, we propose Prototype and Instance Contrastive Learning (PICL), a novel method for unsupervised domain adaptation in speaker verification through dual-level contrastive learning. For prototype contrastive learning, we generate pseudo labels via clustering to create dynamically updated prototype representations, aligning instances with their corresponding class or cluster prototypes. For instance contrastive learning, we minimize the distance between different views or augmentations of the same instance, ensuring robust and invariant represent

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhuang2024prototype

Related papers

• Multi-domain Adaptation By Self-supervised Learning For Speaker Verification (2023)0.00
• Self-supervised Learning Based Domain Adaptation For Robust Speaker Verification (2021)11.49
• Progressive Sub-graph Clustering Algorithm For Semi-supervised Domain Adaptation Speaker Verification (2023)0.00
• Channel Adaptation For Speaker Verification Using Optimal Transport With Pseudo Label (2024)0.00
• Multi-objective Progressive Clustering For Semi-supervised Domain Adaptation In Speaker Verification (2023)5.24
• Unsupervised Voice-face Representation Learning By Cross-modal Prototype Contrast (2022)10.35
• A Generalized Framework For Domain Adaptation Of PLDA In Speaker Recognition (2020)7.50
• Adversarial Training For Multi-domain Speaker Recognition (2020)6.77