Parallel-data-free Voice Conversion Using Cycle-consistent Adversarial Networks

Abstract

We propose a parallel-data-free voice-conversion (VC) method that can learn a mapping from source to target speech without relying on parallel data. The proposed method is general purpose, high quality, and parallel-data free and works without any extra data, modules, or alignment procedure. It also avoids over-smoothing, which occurs in many conventional statistical model-based VC methods. Our method, called CycleGAN-VC, uses a cycle-consistent adversarial network (CycleGAN) with gated convolutional neural networks (CNNs) and an identity-mapping loss. A CycleGAN learns forward and inverse mappings simultaneously using adversarial and cycle-consistency losses. This makes it possible to find an optimal pseudo pair from unpaired data. Furthermore, the adversarial loss contributes to reducing over-smoothing of the converted feature sequence. We configure a CycleGAN with gated CNNs and train it with an identity-mapping loss. This allows the mapping function to capture sequential and hierar

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keykaneko2017parallel

Related papers

• High-quality Nonparallel Voice Conversion Based On Cycle-consistent Adversarial Network (2018)0.00
• Vocoder-free Non-parallel Conversion Of Whispered Speech With Masked Cycle-consistent Generative Adversarial Networks (2023)0.00
• Cyclegan-vc2: Improved Cyclegan-based Non-parallel Voice Conversion (2019)17.45
• Many-to-many Voice Conversion Using Conditional Cycle-consistent Adversarial Networks (2020)10.85
• CVC: Contrastive Learning For Non-parallel Voice Conversion (2020)7.50
• Multi-target Voice Conversion Without Parallel Data By Adversarially Learning Disentangled Audio Representations (2018)13.60
• Non-parallel Voice Conversion With Cyclic Variational Autoencoder (2019)12.10
• Scyclone: High-quality And Parallel-data-free Voice Conversion Using Spectrogram And Cycle-consistent Adversarial Networks (2020)0.00