Semi-supervised Voice Conversion With Amortized Variational Inference

Abstract

In this work we introduce a semi-supervised approach to the voice conversion problem, in which speech from a source speaker is converted into speech of a target speaker. The proposed method makes use of both parallel and non-parallel utterances from the source and target simultaneously during training. This approach can be used to extend existing parallel data voice conversion systems such that they can be trained with semi-supervision. We show that incorporating semi-supervision improves the voice conversion performance compared to fully supervised training when the number of parallel utterances is limited as in many practical applications. Additionally, we find that increasing the number non-parallel utterances used in training continues to improve performance when the amount of parallel training data is held constant.

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keystephenson2019semi

Related papers

• Learning In Your Voice: Non-parallel Voice Conversion Based On Speaker Consistency Loss (2020)0.00
• Parallel And Limited Data Voice Conversion Using Stochastic Variational Deep Kernel Learning (2023)5.84
• ACVAE-VC: Non-parallel Many-to-many Voice Conversion With Auxiliary Classifier Variational Autoencoder (2018)14.69
• Conditional Deep Hierarchical Variational Autoencoder For Voice Conversion (2021)0.00
• Non-parallel Sequence-to-sequence Voice Conversion With Disentangled Linguistic And Speaker Representations (2019)14.02
• Non-parallel Voice Conversion With Cyclic Variational Autoencoder (2019)12.10
• Adversarially Trained Autoencoders For Parallel-data-free Voice Conversion (2019)6.34
• Exploring Voice Conversion Based Data Augmentation In Text-dependent Speaker Verification (2020)0.00