Many-to-many Voice Conversion Using Conditional Cycle-consistent Adversarial Networks

Abstract

Voice conversion (VC) refers to transforming the speaker characteristics of an utterance without altering its linguistic contents. Many works on voice conversion require to have parallel training data that is highly expensive to acquire. Recently, the cycle-consistent adversarial network (CycleGAN), which does not require parallel training data, has been applied to voice conversion, showing the state-of-the-art performance. The CycleGAN based voice conversion, however, can be used only for a pair of speakers, i.e., one-to-one voice conversion between two speakers. In this paper, we extend the CycleGAN by conditioning the network on speakers. As a result, the proposed method can perform many-to-many voice conversion among multiple speakers using a single generative adversarial network (GAN). Compared to building multiple CycleGANs for each pair of speakers, the proposed method reduces the computational and spatial cost significantly without compromising the sound quality of the converte

Stats

• citations27
• S2 citations—
• github stars0
• HF likes0
• heat score10.85
• arxiv keylee2020many

Related papers

• Parallel-data-free Voice Conversion Using Cycle-consistent Adversarial Networks (2017)0.00
• High-quality Nonparallel Voice Conversion Based On Cycle-consistent Adversarial Network (2018)0.00
• Multi-target Voice Conversion Without Parallel Data By Adversarially Learning Disentangled Audio Representations (2018)13.60
• CVC: Contrastive Learning For Non-parallel Voice Conversion (2020)7.50
• Many-to-many Voice Conversion With Out-of-dataset Speaker Support (2019)0.00
• Subband-based Generative Adversarial Network For Non-parallel Many-to-many Voice Conversion (2022)0.00
• Many-to-many Voice Conversion Using Cycle-consistent Variational Autoencoder With Multiple Decoders (2019)6.34
• An Adaptive Learning Based Generative Adversarial Network For One-to-one Voice Conversion (2021)10.61