Channel Adversarial Training For Speaker Verification And Diarization

Abstract

Previous work has encouraged domain-invariance in deep speaker embedding by adversarially classifying the dataset or labelled environment to which the generated features belong. We propose a training strategy which aims to produce features that are invariant at the granularity of the recording or channel, a finer grained objective than dataset- or environment-invariance. By training an adversary to predict whether pairs of same-speaker embeddings belong to the same recording in a Siamese fashion, learned features are discouraged from utilizing channel information that may be speaker discriminative during training. Experiments for verification on VoxCeleb and diarization and verification on CALLHOME show promising improvements over a strong baseline in addition to outperforming a dataset-adversarial model. The VoxCeleb model in particular performs well, achieving a \(4%\) relative improvement in EER over a Kaldi baseline, while using a similar architecture and less training data.

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keyluu2019channel

Related papers

• Channel Adversarial Training For Cross-channel Text-independent Speaker Recognition (2019)0.00
• Adapting End-to-end Neural Speaker Verification To New Languages And Recording Conditions With Adversarial Training (2018)9.59
• Adversarial Training For Multi-domain Speaker Recognition (2020)6.77
• Delving Into Voxceleb: Environment Invariant Speaker Recognition (2019)10.35
• DEAAN: Disentangled Embedding And Adversarial Adaptation Network For Robust Speaker Representation Learning (2020)9.59
• Speaker Verification Using End-to-end Adversarial Language Adaptation (2018)11.19
• A Joint Noise Disentanglement And Adversarial Training Framework For Robust Speaker Verification (2024)6.34
• Robust Speaker Recognition Using Unsupervised Adversarial Invariance (2019)9.76