PL-EESR: Perceptual Loss Based END-TO-END Robust Speaker Representation Extraction

Abstract

Speech enhancement aims to improve the perceptual quality of the speech signal by suppression of the background noise. However, excessive suppression may lead to speech distortion and speaker information loss, which degrades the performance of speaker embedding extraction. To alleviate this problem, we propose an end-to-end deep learning framework, dubbed PL-EESR, for robust speaker representation extraction. This framework is optimized based on the feedback of the speaker identification task and the high-level perceptual deviation between the raw speech signal and its noisy version. We conducted speaker verification tasks in both noisy and clean environment respectively to evaluate our system. Compared to the baseline, our method shows better performance in both clean and noisy environments, which means our method can not only enhance the speaker relative information but also avoid adding distortions.

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keyma2021pl

Related papers

• Perceptual Loss Based Speech Denoising With An Ensemble Of Audio Pattern Recognition And Self-supervised Models (2020)10.21
• SEEF-ALDR: A Speaker Embedding Enhancement Framework Via Adversarial Learning Based Disentangled Representation (2019)3.58
• Personalized Speech Enhancement Without A Separate Speaker Embedding Model (2024)5.24
• Electrolaryngeal Speech Intelligibility Enhancement Through Robust Linguistic Encoders (2023)6.34
• Perceive And Predict: Self-supervised Speech Representation Based Loss Functions For Speech Enhancement (2023)7.16
• Analyzing Speaker Verification Embedding Extractors And Back-ends Under Language And Channel Mismatch (2022)0.00
• Joint Speaker Encoder And Neural Back-end Model For Fully End-to-end Automatic Speaker Verification With Multiple Enrollment Utterances (2022)0.00
• Unsupervised Feature Enhancement For Speaker Verification (2019)5.84