A Unified Deep Learning Framework For Short-duration Speaker Verification In Adverse Environments

Abstract

Speaker verification (SV) has recently attracted considerable research interest due to the growing popularity of virtual assistants. At the same time, there is an increasing requirement for an SV system: it should be robust to short speech segments, especially in noisy and reverberant environments. In this paper, we consider one more important requirement for practical applications: the system should be robust to an audio stream containing long non-speech segments, where a voice activity detection (VAD) is not applied. To meet these two requirements, we introduce feature pyramid module (FPM)-based multi-scale aggregation (MSA) and self-adaptive soft VAD (SAS-VAD). We present the FPM-based MSA to deal with short speech segments in noisy and reverberant environments. Also, we use the SAS-VAD to increase the robustness to long non-speech segments. To further improve the robustness to acoustic distortions (i.e., noise and reverberation), we apply a masking-based speech enhancement (SE) met

Stats

• citations17
• S2 citations—
• github stars0
• HF likes0
• heat score9.41
• arxiv keyjung2020a

Related papers

• Improving Multi-scale Aggregation Using Feature Pyramid Module For Robust Speaker Verification Of Variable-duration Utterances (2020)10.48
• Speaker Verification In Multi-speaker Environments Using Temporal Feature Fusion (2022)0.00
• Self-adaptive Soft Voice Activity Detection Using Deep Neural Networks For Robust Speaker Verification (2019)6.77
• Short-segment Speaker Verification With Pre-trained Models And Multi-resolution Encoder (2025)0.00
• Rsknet-mtsp: Effective And Portable Deep Architecture For Speaker Verification (2021)9.03
• How To Leverage Dnn-based Speech Enhancement For Multi-channel Speaker Verification? (2022)0.00
• Deep Speaker Embeddings For Far-field Speaker Recognition On Short Utterances (2020)11.29
• Diff-sv: A Unified Hierarchical Framework For Noise-robust Speaker Verification Using Score-based Diffusion Probabilistic Models (2023)6.34