U-mamba-net: A Highly Efficient Mamba-based U-net Style Network For Noisy And Reverberant Speech Separation
2024 · Shaoxiang Dang, Tetsuya Matsumoto, Yoshinori Takeuchi, et al.
Abstract
The topic of speech separation involves separating mixed speech with multiple overlapping speakers into several streams, with each stream containing speech from only one speaker. Many highly effective models have emerged and proliferated rapidly over time. However, the size and computational load of these models have also increased accordingly. This is a disaster for the community, as researchers need more time and computational resources to reproduce and compare existing models. In this paper, we propose U-mamba-net: a lightweight Mamba-based U-style model for speech separation in complex environments. Mamba is a state space sequence model that incorporates feature selection capabilities. U-style network is a fully convolutional neural network whose symmetric contracting and expansive paths are able to learn multi-resolution features. In our work, Mamba serves as a feature filter, alternating with U-Net. We test the proposed model on Libri2mix. The results show that U-Mamba-Net achiev
Authors
(none)
Tags
Stats
Related papers
- Mamba-seunet: Mamba Unet For Monaural Speech Enhancement (2024)7.16
- Cleanumamba: A Compact Mamba Network For Speech Denoising Using Channel Pruning (2024)6.34
- Dual-path Mamba: Short And Long-term Bidirectional Selective Structured State Space Models For Speech Separation (2024)4.12
- Leveraging Joint Spectral And Spatial Learning With MAMBA For Multichannel Speech Enhancement (2024)0.00
- Mamba2 Meets Silence: Robust Vocal Source Separation For Sparse Regions (2025)0.00
- Dilated U-net Based Approach For Multichannel Speech Enhancement From First-order Ambisonics Recordings (2020)0.00
- Wave-u-net: A Multi-scale Neural Network For End-to-end Audio Source Separation (2018)0.00
- Speech Slytherin: Examining The Performance And Efficiency Of Mamba For Speech Separation, Recognition, And Synthesis (2024)13.88