Time-domain Audio Source Separation Based On Wave-u-net Combined With Discrete Wavelet Transform

Abstract

We propose a time-domain audio source separation method using down-sampling (DS) and up-sampling (US) layers based on a discrete wavelet transform (DWT). The proposed method is based on one of the state-of-the-art deep neural networks, Wave-U-Net, which successively down-samples and up-samples feature maps. We find that this architecture resembles that of multiresolution analysis, and reveal that the DS layers of Wave-U-Net cause aliasing and may discard information useful for the separation. Although the effects of these problems may be reduced by training, to achieve a more reliable source separation method, we should design DS layers capable of overcoming the problems. With this belief, focusing on the fact that the DWT has an anti-aliasing filter and the perfect reconstruction property, we design the proposed layers. Experiments on music source separation show the efficacy of the proposed method and the importance of simultaneously considering the anti-aliasing filters and the perf

Stats

• citations19
• S2 citations—
• github stars0
• HF likes0
• heat score9.76
• arxiv keynakamura2020time

Related papers

• Wave-u-net: A Multi-scale Neural Network For End-to-end Audio Source Separation (2018)0.00
• Audio Source Separation Via Multi-scale Learning With Dilated Dense U-nets (2019)0.00
• Music Source Separation In The Waveform Domain (2019)0.00
• Depthwise Separable Convolutions Versus Recurrent Neural Networks For Monaural Singing Voice Separation (2020)0.00
• Improved Speech Enhancement With The Wave-u-net (2018)0.00
• End-to-end Music Source Separation: Is It Possible In The Waveform Domain? (2018)11.58
• Htmd-net: A Hybrid Masking-denoising Approach To Time-domain Monaural Singing Voice Separation (2021)2.26
• Raw Multi-channel Audio Source Separation Using Multi-resolution Convolutional Auto-encoders (2018)11.58