Deep Encoder-decoder Models For Unsupervised Learning Of Controllable Speech Synthesis
2018 · Gustav Eje Henter, Jaime Lorenzo-Trueba, Xin Wang, et al.
Abstract
Generating versatile and appropriate synthetic speech requires control over the output expression separate from the spoken text. Important non-textual speech variation is seldom annotated, in which case output control must be learned in an unsupervised fashion. In this paper, we perform an in-depth study of methods for unsupervised learning of control in statistical speech synthesis. For example, we show that popular unsupervised training heuristics can be interpreted as variational inference in certain autoencoder models. We additionally connect these models to VQ-VAEs, another, recently-proposed class of deep variational autoencoders, which we show can be derived from a very similar mathematical argument. The implications of these new probabilistic interpretations are discussed. We illustrate the utility of the various approaches with an application to acoustic modelling for emotional speech synthesis, where the unsupervised methods for learning expression control (without access to
Authors
(none)
Tags
Stats
Related papers
- Learning And Controlling The Source-filter Representation Of Speech With A Variational Autoencoder (2022)7.50
- Learning Latent Representations For Speech Generation And Transformation (2017)13.50
- Expressive Speech Synthesis Via Modeling Expressions With Variational Autoencoder (2018)13.88
- Learning Latent Representations For Style Control And Transfer In End-to-end Speech Synthesis (2018)0.00
- A Statistically Principled And Computationally Efficient Approach To Speech Enhancement Using Variational Autoencoders (2019)9.23
- Semi-supervised Learning For Continuous Emotional Intensity Controllable Speech Synthesis With Disentangled Representations (2022)0.00
- Conditional Deep Hierarchical Variational Autoencoder For Voice Conversion (2021)0.00
- Hierarchical Generative Modeling For Controllable Speech Synthesis (2018)0.00