A Multi-stage Triple-path Method For Speech Separation In Noisy And Reverberant Environments

Abstract

In noisy and reverberant environments, the performance of deep learning-based speech separation methods drops dramatically because previous methods are not designed and optimized for such situations. To address this issue, we propose a multi-stage end-to-end learning method that decouples the difficult speech separation problem in noisy and reverberant environments into three sub-problems: speech denoising, separation, and de-reverberation. The probability and speed of searching for the optimal solution of the speech separation model are improved by reducing the solution space. Moreover, since the channel information of the audio sequence in the time domain is crucial for speech separation, we propose a triple-path structure capable of modeling the channel dimension of audio sequences. Experimental results show that the proposed multi-stage triple-path method can improve the performance of speech separation models at the cost of little model parameter increment.

Stats

• citations1
• S2 citations—
• github stars0
• HF likes0
• heat score2.26
• arxiv keymu2023a

Related papers

• Audio-visual Speech Separation And Dereverberation With A Two-stage Multimodal Network (2019)12.47
• Two-stage Model And Optimal SI-SNR For Monaural Multi-speaker Speech Separation In Noisy Environment (2020)0.00
• End-to-end Multi-channel Speech Separation (2019)0.00
• Efficient Integration Of Multi-channel Information For Speaker-independent Speech Separation (2020)0.00
• SADDEL: Joint Speech Separation And Denoising Model Based On Multitask Learning (2020)0.00
• End-to-end Networks For Supervised Single-channel Speech Separation (2018)0.00
• End-to-end Dereverberation, Beamforming, And Speech Recognition With Improved Numerical Stability And Advanced Frontend (2021)10.97
• Unifying Speech Enhancement And Separation With Gradient Modulation For End-to-end Noise-robust Speech Separation (2023)0.00