CVC: Contrastive Learning For Non-parallel Voice Conversion

Abstract

Cycle consistent generative adversarial network (CycleGAN) and variational autoencoder (VAE) based models have gained popularity in non-parallel voice conversion recently. However, they often suffer from difficult training process and unsatisfactory results. In this paper, we propose CVC, a contrastive learning-based adversarial approach for voice conversion. Compared to previous CycleGAN-based methods, CVC only requires an efficient one-way GAN training by taking the advantage of contrastive learning. When it comes to non-parallel one-to-one voice conversion, CVC is on par or better than CycleGAN and VAE while effectively reducing training time. CVC further demonstrates superior performance in many-to-one voice conversion, enabling the conversion from unseen speakers.

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keyli2020cvc

Related papers

• High-quality Nonparallel Voice Conversion Based On Cycle-consistent Adversarial Network (2018)0.00
• Parallel-data-free Voice Conversion Using Cycle-consistent Adversarial Networks (2017)0.00
• Cyclegan-vc2: Improved Cyclegan-based Non-parallel Voice Conversion (2019)17.45
• Non-parallel Voice Conversion With Cyclic Variational Autoencoder (2019)12.10
• Many-to-many Voice Conversion Using Conditional Cycle-consistent Adversarial Networks (2020)10.85
• Vocoder-free Non-parallel Conversion Of Whispered Speech With Masked Cycle-consistent Generative Adversarial Networks (2023)0.00
• An Adaptive Learning Based Generative Adversarial Network For One-to-one Voice Conversion (2021)10.61
• Baseline System Of Voice Conversion Challenge 2020 With Cyclic Variational Autoencoder And Parallel Wavegan (2020)4.24