End-to-end DNN Based Speaker Recognition Inspired By I-vector And PLDA

Abstract

Recently several end-to-end speaker verification systems based on deep neural networks (DNNs) have been proposed. These systems have been proven to be competitive for text-dependent tasks as well as for text-independent tasks with short utterances. However, for text-independent tasks with longer utterances, end-to-end systems are still outperformed by standard i-vector + PLDA systems. In this work, we develop an end-to-end speaker verification system that is initialized to mimic an i-vector + PLDA baseline. The system is then further trained in an end-to-end manner but regularized so that it does not deviate too far from the initial system. In this way we mitigate overfitting which normally limits the performance of end-to-end systems. The proposed system outperforms the i-vector + PLDA baseline on both long and short duration utterances.

Stats

• citations23
• S2 citations—
• github stars0
• HF likes0
• heat score10.35
• arxiv keyrohdin2017end

Related papers

• Deep Neural Network Based I-vector Mapping For Speaker Verification Using Short Utterances (2018)0.00
• End-to-end Attention Based Text-dependent Speaker Verification (2017)14.87
• Multiobjective Optimization Training Of PLDA For Speaker Verification (2018)2.26
• Investigation Of Using VAE For I-vector Speaker Verification (2017)0.00
• DNN Based Speaker Recognition On Short Utterances (2016)0.00
• Text-independent Speaker Verification Based On Deep Neural Networks And Segmental Dynamic Time Warping (2018)3.58
• Joint Speaker Encoder And Neural Back-end Model For Fully End-to-end Automatic Speaker Verification With Multiple Enrollment Utterances (2022)0.00
• Domain Adaptation Based Speaker Recognition On Short Utterances (2016)0.00