Investigating Deep Neural Structures And Their Interpretability In The Domain Of Voice Conversion

Abstract

Generative Adversarial Networks (GANs) are machine learning networks based around creating synthetic data. Voice Conversion (VC) is a subset of voice translation that involves translating the paralinguistic features of a source speaker to a target speaker while preserving the linguistic information. The aim of non-parallel conditional GANs for VC is to translate an acoustic speech feature sequence from one domain to another without the use of paired data. In the study reported here, we investigated the interpretability of state-of-the-art implementations of non-parallel GANs in the domain of VC. We show that the learned representations in the repeating layers of a particular GAN architecture remain close to their original random initialised parameters, demonstrating that it is the number of repeating layers that is more responsible for the quality of the output. We also analysed the learned representations of a model trained on one particular dataset when used during transfer learning

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybroughton2021investigating

Related papers

• Generative Adversarial Network Based Voice Conversion: Techniques, Challenges, And Recent Advancements (2025)0.00
• Collective Learning Mechanism Based Optimal Transport Generative Adversarial Network For Non-parallel Voice Conversion (2025)0.00
• An Adaptive Learning Based Generative Adversarial Network For One-to-one Voice Conversion (2021)10.61
• Starganv2-vc: A Diverse, Unsupervised, Non-parallel Framework For Natural-sounding Voice Conversion (2021)13.70
• Stargan-vc: Non-parallel Many-to-many Voice Conversion With Star Generative Adversarial Networks (2018)18.09
• Voice Conversion From Unaligned Corpora Using Variational Autoencoding Wasserstein Generative Adversarial Networks (2017)16.34
• Subband-based Generative Adversarial Network For Non-parallel Many-to-many Voice Conversion (2022)0.00
• High-quality Nonparallel Voice Conversion Based On Cycle-consistent Adversarial Network (2018)0.00