Spectrogram-channels U-net: A Source Separation Model Viewing Each Channel As The Spectrogram Of Each Source

Abstract

Sound source separation has attracted attention from Music Information Retrieval(MIR) researchers, since it is related to many MIR tasks such as automatic lyric transcription, singer identification, and voice conversion. In this paper, we propose an intuitive spectrogram-based model for source separation by adapting U-Net. We call it Spectrogram-Channels U-Net, which means each channel of the output corresponds to the spectrogram of separated source itself. The proposed model can be used for not only singing voice separation but also multi-instrument separation by changing only the number of output channels. In addition, we propose a loss function that balances volumes between different sources. Finally, we yield performance that is state-of-the-art on both separation tasks.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyoh2018spectrogram

Related papers

• Wave-u-net: A Multi-scale Neural Network For End-to-end Audio Source Separation (2018)0.00
• Investigating U-nets With Various Intermediate Blocks For Spectrogram-based Singing Voice Separation (2019)0.00
• End-to-end Networks For Supervised Single-channel Speech Separation (2018)0.00
• Improving Singing Voice Separation Using Deep U-net And Wave-u-net With Data Augmentation (2019)10.35
• Music Source Separation In The Waveform Domain (2019)0.00
• End-to-end Music Source Separation: Is It Possible In The Waveform Domain? (2018)11.58
• Raw Multi-channel Audio Source Separation Using Multi-resolution Convolutional Auto-encoders (2018)11.58
• Improving Singing Voice Separation With The Wave-u-net Using Minimum Hyperspherical Energy (2019)7.16