Pitchnet: Unsupervised Singing Voice Conversion With Pitch Adversarial Network

Abstract

Singing voice conversion is to convert a singer's voice to another one's voice without changing singing content. Recent work shows that unsupervised singing voice conversion can be achieved with an autoencoder-based approach [1]. However, the converted singing voice can be easily out of key, showing that the existing approach cannot model the pitch information precisely. In this paper, we propose to advance the existing unsupervised singing voice conversion method proposed in [1] to achieve more accurate pitch translation and flexible pitch manipulation. Specifically, the proposed PitchNet added an adversarially trained pitch regression network to enforce the encoder network to learn pitch invariant phoneme representation, and a separate module to feed pitch extracted from the source audio to the decoder network. Our evaluation shows that the proposed method can greatly improve the quality of the converted singing voice (2.92 vs 3.75 in MOS). We also demonstrate that the pitch of conve

Stats

• citations28
• S2 citations—
• github stars0
• HF likes0
• heat score10.97
• arxiv keydeng2019pitchnet

Related papers

• Unsupervised Singing Voice Conversion (2019)11.19
• Ppg-based Singing Voice Conversion With Adversarial Representation Learning (2020)9.76
• Human Voice Pitch Estimation: A Convolutional Network With Auto-labeled And Synthetic Data (2023)0.00
• Phonetic Posteriorgrams Based Many-to-many Singing Voice Conversion Via Adversarial Training (2020)0.00
• Singing Voice Conversion With Non-parallel Data (2019)9.59
• Adversarial Multi-task Learning For Disentangling Timbre And Pitch In Singing Voice Synthesis (2022)4.52
• A Data-driven Approach To Smooth Pitch Correction For Singing Voice In Pop Music (2018)0.00
• Self-supervised Singing Voice Pre-training Towards Speech-to-singing Conversion (2024)0.00