Mimo-dbnet: Multi-channel Input And Multiple Outputs Doa-aware Beamforming Network For Speech Separation

Abstract

Recently, many deep learning based beamformers have been proposed for multi-channel speech separation. Nevertheless, most of them rely on extra cues known in advance, such as speaker feature, face image or directional information. In this paper, we propose an end-to-end beamforming network for direction guided speech separation given merely the mixture signal, namely MIMO-DBnet. Specifically, we design a multi-channel input and multiple outputs architecture to predict the direction-of-arrival based embeddings and beamforming weights for each source. The precisely estimated directional embedding provides quite effective spatial discrimination guidance for the neural beamformer to offset the effect of phase wrapping, thus allowing more accurate reconstruction of two sources' speech signals. Experiments show that our proposed MIMO-DBnet not only achieves a comprehensive decent improvement compared to baseline systems, but also maintain the performance on high frequency bands when phase wr

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfu2022mimo

Related papers

• DBNET: Doa-driven Beamforming Network For End-to-end Farfield Sound Source Separation (2020)0.00
• Locate And Beamform: Two-dimensional Locating All-neural Beamformer For Multi-channel Speech Separation (2023)3.58
• 3D Neural Beamforming For Multi-channel Speech Separation Against Location Uncertainty (2023)0.00
• Multichannel Loss Function For Supervised Speech Source Separation By Mask-based Beamforming (2019)7.50
• Cracking The Cocktail Party Problem By Multi-beam Deep Attractor Network (2018)9.92
• Sequential Multi-frame Neural Beamforming For Speech Separation And Enhancement (2019)0.00
• Beam-guided Tasnet: An Iterative Speech Separation Framework With Multi-channel Output (2021)9.76
• MIMO-SPEECH: End-to-end Multi-channel Multi-speaker Speech Recognition (2019)13.93