Data Efficient Voice Cloning For Neural Singing Synthesis

Abstract

There are many use cases in singing synthesis where creating voices from small amounts of data is desirable. In text-to-speech there have been several promising results that apply voice cloning techniques to modern deep learning based models. In this work, we adapt one such technique to the case of singing synthesis. By leveraging data from many speakers to first create a multispeaker model, small amounts of target data can then efficiently adapt the model to new unseen voices. We evaluate the system using listening tests across a number of different use cases, languages and kinds of data.

Stats

• citations21
• S2 citations—
• github stars0
• HF likes0
• heat score10.07
• arxiv keyblaauw2019data

Related papers

• Neural Voice Cloning With A Few Samples (2018)0.00
• Data Efficient Voice Cloning From Noisy Samples With Domain Adversarial Training (2020)9.92
• Voice Cloning: A Multi-speaker Text-to-speech Synthesis Approach Based On Transfer Learning (2021)0.00
• Everyone-can-sing: Zero-shot Singing Voice Synthesis And Conversion With Speech Reference (2025)0.00
• Improve Cross-lingual Voice Cloning Using Low-quality Code-switched Data (2021)0.00
• Adapting TTS Models For New Speakers Using Transfer Learning (2021)0.00
• Spoken Language Corpora Augmentation With Domain-specific Voice-cloned Speech (2024)0.00
• Single And Multi-speaker Cloned Voice Detection: From Perceptual To Learned Features (2023)9.23