CLN-VC: Text-free Voice Conversion Based On Fine-grained Style Control And Contrastive Learning With Negative Samples Augmentation
2023 · Yimin Deng, Xulong Zhang, Jianzong Wang, et al.
Abstract
Better disentanglement of speech representation is essential to improve the quality of voice conversion. Recently contrastive learning is applied to voice conversion successfully based on speaker labels. However, the performance of model will reduce in conversion between similar speakers. Hence, we propose an augmented negative sample selection to address the issue. Specifically, we create hard negative samples based on the proposed speaker fusion module to improve learning ability of speaker encoder. Furthermore, considering the fine-grain modeling of speaker style, we employ a reference encoder to extract fine-grained style and conduct the augmented contrastive learning on global style. The experimental results show that the proposed method outperforms previous work in voice conversion tasks.
Authors
(none)
Tags
Stats
Related papers
- ZSVC: Zero-shot Style Voice Conversion With Disentangled Latent Diffusion Models And Adversarial Training (2025)0.00
- Learning Disentangled Speech Representations With Contrastive Learning And Time-invariant Retrieval (2024)5.84
- Improving Zero-shot Voice Style Transfer Via Disentangled Representation Learning (2021)0.00
- Seeing Your Speech Style: A Novel Zero-shot Identity-disentanglement Face-based Voice Conversion (2024)4.52
- Delivering Speaking Style In Low-resource Voice Conversion With Multi-factor Constraints (2022)5.24
- Learning In Your Voice: Non-parallel Voice Conversion Based On Speaker Consistency Loss (2020)0.00
- Enriching Source Style Transfer In Recognition-synthesis Based Non-parallel Voice Conversion (2021)9.23
- Voice Conversion With Conditional Samplernn (2018)7.50