Mmdenselstm: An Efficient Combination Of Convolutional And Recurrent Neural Networks For Audio Source Separation

Abstract

Deep neural networks have become an indispensable technique for audio source separation (ASS). It was recently reported that a variant of CNN architecture called MMDenseNet was successfully employed to solve the ASS problem of estimating source amplitudes, and state-of-the-art results were obtained for DSD100 dataset. To further enhance MMDenseNet, here we propose a novel architecture that integrates long short-term memory (LSTM) in multiple scales with skip connections to efficiently model long-term structures within an audio context. The experimental results show that the proposed method outperforms MMDenseNet, LSTM and a blend of the two networks. The number of parameters and processing time of the proposed model are significantly less than those for simple blending. Furthermore, the proposed method yields better results than those obtained using ideal binary masks for a singing voice separation task.

Stats

• citations108
• S2 citations—
• github stars0
• HF likes0
• heat score15.28
• arxiv keytakahashi2018mmdenselstm

Related papers

• Voice And Accompaniment Separation In Music Using Self-attention Convolutional Neural Network (2020)0.00
• D3net: Densely Connected Multidilated Densenet For Music Source Separation (2020)0.00
• Depthwise Separable Convolutions Versus Recurrent Neural Networks For Monaural Singing Voice Separation (2020)0.00
• A Recurrent Encoder-decoder Approach With Skip-filtering Connections For Monaural Singing Voice Separation (2017)9.41
• Interleaved Multitask Learning For Audio Source Separation With Independent Databases (2019)0.00
• Source Separation And Depthwise Separable Convolutions For Computer Audition (2020)0.00
• Htmd-net: A Hybrid Masking-denoising Approach To Time-domain Monaural Singing Voice Separation (2021)2.26
• Audio Source Separation Via Multi-scale Learning With Dilated Dense U-nets (2019)0.00