Mask-dependent Phase Estimation For Monaural Speaker Separation

Abstract

Speaker separation refers to isolating speech of interest in a multi-talker environment. Most methods apply real-valued Time-Frequency (T-F) masks to the mixture Short-Time Fourier Transform (STFT) to reconstruct the clean speech. Hence there is an unavoidable mismatch between the phase of the reconstruction and the original phase of the clean speech. In this paper, we propose a simple yet effective phase estimation network that predicts the phase of the clean speech based on a T-F mask predicted by a chimera++ network. To overcome the label-permutation problem for both the T-F mask and the phase, we propose a mask-dependent permutation invariant training (PIT) criterion to select the phase signal based on the loss from the T-F mask prediction. We also propose an Inverse Mask Weighted Loss Function for phase prediction to focus the model on the T-F regions in which the phase is more difficult to predict. Results on the WSJ0-2mix dataset show that the phase estimation network achieves c

Stats

• citations6
• S2 citations—
• github stars0
• HF likes0
• heat score6.34
• arxiv keyni2019mask

Related papers

• End-to-end Speech Separation With Unfolded Iterative Phase Reconstruction (2018)15.00
• Deep Learning Based Phase Reconstruction For Speaker Separation: A Trigonometric Perspective (2018)13.34
• Voicefilter: Targeted Voice Separation By Speaker-conditioned Spectrogram Masking (2018)17.48
• Individualized Conditioning And Negative Distances For Speaker Separation (2022)2.26
• Online Binaural Speech Separation Of Moving Speakers With A Wavesplit Network (2023)5.24
• Htmd-net: A Hybrid Masking-denoising Approach To Time-domain Monaural Singing Voice Separation (2021)2.26
• Dual-path Filter Network: Speaker-aware Modeling For Speech Separation (2021)3.58
• Permutation Invariant Training Of Deep Models For Speaker-independent Multi-talker Speech Separation (2016)0.00