Generative Adversarial Speaker Embedding Networks For Domain Robust End-to-end Speaker Verification

Abstract

This article presents a novel approach for learning domain-invariant speaker embeddings using Generative Adversarial Networks. The main idea is to confuse a domain discriminator so that is can't tell if embeddings are from the source or target domains. We train several GAN variants using our proposed framework and apply them to the speaker verification task. On the challenging NIST-SRE 2016 dataset, we are able to match the performance of a strong baseline x-vector system. In contrast to the the baseline systems which are dependent on dimensionality reduction (LDA) and an external classifier (PLDA), our proposed speaker embeddings can be scored using simple cosine distance. This is achieved by optimizing our models end-to-end, using an angular margin loss function. Furthermore, we are able to significantly boost verification performance by averaging our different GAN models at the score level, achieving a relative improvement of 7.2% over the baseline.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybhattacharya2018generative

Related papers

• Adapting End-to-end Neural Speaker Verification To New Languages And Recording Conditions With Adversarial Training (2018)9.59
• Vae-based Domain Adaptation For Speaker Verification (2019)7.50
• Single Channel Far Field Feature Enhancement For Speaker Verification In The Wild (2020)0.00
• Robust Speech Recognition Using Generative Adversarial Networks (2017)11.29
• Speaker Verification Using End-to-end Adversarial Language Adaptation (2018)11.19
• DEAAN: Disentangled Embedding And Adversarial Adaptation Network For Robust Speaker Representation Learning (2020)9.59
• I-vector Transformation Using Conditional Generative Adversarial Networks For Short Utterance Speaker Verification (2018)8.35
• Generative X-vectors For Text-independent Speaker Verification (2018)7.16