Meta-voice: Fast Few-shot Style Transfer For Expressive Voice Cloning Using Meta Learning
2021 · Songxiang Liu, Dan Su, Dong Yu
Abstract
The task of few-shot style transfer for voice cloning in text-to-speech (TTS) synthesis aims at transferring speaking styles of an arbitrary source speaker to a target speaker's voice using very limited amount of neutral data. This is a very challenging task since the learning algorithm needs to deal with few-shot voice cloning and speaker-prosody disentanglement at the same time. Accelerating the adaptation process for a new target speaker is of importance in real-world applications, but even more challenging. In this paper, we approach to the hard fast few-shot style transfer for voice cloning task using meta learning. We investigate the model-agnostic meta-learning (MAML) algorithm and meta-transfer a pre-trained multi-speaker and multi-prosody base TTS model to be highly sensitive for adaptation with few samples. Domain adversarial training mechanism and orthogonal constraint are adopted to disentangle speaker and prosody representations for effective cross-speaker style transfer.
Authors
(none)
Tags
Stats
Related papers
- Meta-tts: Meta-learning For Few-shot Speaker Adaptive Text-to-speech (2021)12.74
- Investigating On Incorporating Pretrained And Learnable Speaker Representations For Multi-speaker Multi-style Text-to-speech (2021)11.67
- Unet-tts: Improving Unseen Speaker And Style Transfer In One-shot Voice Cloning (2021)0.00
- Adapting TTS Models For New Speakers Using Transfer Learning (2021)0.00
- Voice Cloning: A Multi-speaker Text-to-speech Synthesis Approach Based On Transfer Learning (2021)0.00
- One-shot Voice Conversion For Style Transfer Based On Speaker Adaptation (2021)8.09
- U-style: Cascading U-nets With Multi-level Speaker And Style Modeling For Zero-shot Voice Cloning (2023)6.77
- Improving Data Augmentation-based Cross-speaker Style Transfer For TTS With Singing Voice, Style Filtering, And F0 Matching (2024)0.00