An Overview Of Voice Conversion And Its Challenges: From Statistical Modeling To Deep Learning
2020 · Berrak Sisman, Junichi Yamagishi, Simon King, et al.
Abstract
Speaker identity is one of the important characteristics of human speech. In voice conversion, we change the speaker identity from one to another, while keeping the linguistic content unchanged. Voice conversion involves multiple speech processing techniques, such as speech analysis, spectral conversion, prosody conversion, speaker characterization, and vocoding. With the recent advances in theory and practice, we are now able to produce human-like voice quality with high speaker similarity. In this paper, we provide a comprehensive overview of the state-of-the-art of voice conversion techniques and their performance evaluation methods from the statistical approaches to deep learning, and discuss their promise and limitations. We will also report the recent Voice Conversion Challenges (VCC), the performance of the current state of technology, and provide a summary of the available resources for voice conversion research.
Authors
(none)
Tags
Stats
Related papers
- Generative Adversarial Network Based Voice Conversion: Techniques, Challenges, And Recent Advancements (2025)0.00
- The Voice Conversion Challenge 2018: Promoting Development Of Parallel And Nonparallel Methods (2018)17.06
- Reimagining Speech: A Scoping Review Of Deep Learning-powered Voice Conversion (2023)0.00
- How Far Are We From Robust Voice Conversion: A Survey (2020)9.41
- Beyond Voice Identity Conversion: Manipulating Voice Attributes By Adversarial Learning Of Structured Disentangled Representations (2021)0.00
- Residual Speaker Representation For One-shot Voice Conversion (2023)0.00
- Learning In Your Voice: Non-parallel Voice Conversion Based On Speaker Consistency Loss (2020)0.00
- An Overview & Analysis Of Sequence-to-sequence Emotional Voice Conversion (2022)8.60