Label-efficient Self-supervised Speaker Verification With Information Maximization And Contrastive Learning

Abstract

State-of-the-art speaker verification systems are inherently dependent on some kind of human supervision as they are trained on massive amounts of labeled data. However, manually annotating utterances is slow, expensive and not scalable to the amount of data available today. In this study, we explore self-supervised learning for speaker verification by learning representations directly from raw audio. The objective is to produce robust speaker embeddings that have small intra-speaker and large inter-speaker variance. Our approach is based on recent information maximization learning frameworks and an intensive data augmentation pre-processing step. We evaluate the ability of these methods to work without contrastive samples before showing that they achieve better performance when combined with a contrastive loss. Furthermore, we conduct experiments to show that our method reaches competitive results compared to existing techniques and can get better performances compared to a supervised

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keylepage2022label

Related papers

• Experimenting With Additive Margins For Contrastive Self-supervised Speaker Verification (2023)4.52
• Self-supervised Text-independent Speaker Verification Using Prototypical Momentum Contrastive Learning (2020)12.93
• Asymmetric Clean Segments-guided Self-supervised Learning For Robust Speaker Verification (2023)5.84
• Speaker Representation Learning Via Contrastive Loss With Maximal Speaker Separability (2022)10.68
• Pushing The Limits Of Self-supervised Speaker Verification Using Regularized Distillation Framework (2022)17.00
• Self-supervised Speaker Verification With Simple Siamese Network And Self-supervised Regularization (2021)10.85
• Towards Supervised Performance On Speaker Verification With Self-supervised Learning By Leveraging Large-scale ASR Models (2024)7.50
• Curriculum Learning For Self-supervised Speaker Verification (2022)8.09