Self-supervised Speaker Recognition Training Using Human-machine Dialogues

Abstract

Speaker recognition, recognizing speaker identities based on voice alone, enables important downstream applications, such as personalization and authentication. Learning speaker representations, in the context of supervised learning, heavily depends on both clean and sufficient labeled data, which is always difficult to acquire. Noisy unlabeled data, on the other hand, also provides valuable information that can be exploited using self-supervised training methods. In this work, we investigate how to pretrain speaker recognition models by leveraging dialogues between customers and smart-speaker devices. However, the supervisory information in such dialogues is inherently noisy, as multiple speakers may speak to a device in the course of the same dialogue. To address this issue, we propose an effective rejection mechanism that selectively learns from dialogues based on their acoustic homogeneity. Both reconstruction-based and contrastive-learning-based self-supervised methods are compare

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keycekic2022self

Related papers

• Self-supervised Learning From Contrastive Mixtures For Personalized Speech Enhancement (2020)0.00
• Efficient Personalized Speech Enhancement Through Self-supervised Learning (2021)10.21
• Augmentation Adversarial Training For Self-supervised Speaker Recognition (2020)0.00
• Self-supervised Reflective Learning Through Self-distillation And Online Clustering For Speaker Representation Learning (2024)2.26
• Label-efficient Self-supervised Speaker Verification With Information Maximization And Contrastive Learning (2022)6.77
• A Machine Of Few Words -- Interactive Speaker Recognition With Reinforcement Learning (2020)5.24
• Speaker De-identification System Using Autoencoders And Adversarial Training (2020)0.00
• Personalized Speech Enhancement Through Self-supervised Data Augmentation And Purification (2021)9.92