Multi-task Single Channel Speech Enhancement Using Speech Presence Probability As A Secondary Task Training Target

Abstract

To cope with reverberation and noise in single channel acoustic scenarios, typical supervised deep neural network~(DNN)-based techniques learn a mapping from reverberant and noisy input features to a user-defined target. Commonly used targets are the desired signal magnitude, a time-frequency mask such as the Wiener gain, or the interference power spectral density and signal-to-interference ratio that can be used to compute a time-frequency mask. In this paper, we propose to incorporate multi-task learning in such DNN-based enhancement techniques by using speech presence probability (SPP) estimation as a secondary task assisting the target estimation in the main task. The advantage of multi-task learning lies in sharing domain-specific information between the two tasks (i.e., target and SPP estimation) and learning more generalizable and robust representations. To simultaneously learn both tasks, we propose to use the adaptive weighting method of losses derived from the homoscedastic u

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keywang2020multi

Related papers

• Learning-based A Posteriori Speech Presence Probability Estimation And Applications (2025)0.00
• Frequency Bin-wise Single Channel Speech Presence Probability Estimation Using Multiple Dnns (2023)5.84
• Dnn-based Speech Presence Probability Estimation For Multi-frame Single-microphone Speech Enhancement (2019)8.82
• Incorporating Multi-target In Multi-stage Speech Enhancement Model For Better Generalization (2021)0.00
• Speech Enhancement Via Two-stage Dual Tree Complex Wavelet Packet Transform With A Speech Presence Probability Estimator (2016)5.84
• Distortionless Multi-channel Target Speech Enhancement For Overlapped Speech Recognition (2020)0.00
• Multi-objective Learning And Mask-based Post-processing For Deep Neural Network Based Speech Enhancement (2017)9.76
• Self-supervised Learning Based Monaural Speech Enhancement With Multi-task Pre-training (2021)0.00