Statistical Parametric Speech Synthesis Using Bottleneck Representation From Sequence Auto-encoder

Abstract

In this paper, we describe a statistical parametric speech synthesis approach with unit-level acoustic representation. In conventional deep neural network based speech synthesis, the input text features are repeated for the entire duration of phoneme for mapping text and speech parameters. This mapping is learnt at the frame-level which is the de-facto acoustic representation. However much of this computational requirement can be drastically reduced if every unit can be represented with a fixed-dimensional representation. Using recurrent neural network based auto-encoder, we show that it is indeed possible to map units of varying duration to a single vector. We then use this acoustic representation at unit-level to synthesize speech using deep neural network based statistical parametric speech synthesis technique. Results show that the proposed approach is able to synthesize at the same quality as the conventional frame based approach at a highly reduced computational cost.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyachanta2016statistical

Related papers

• Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networks (2017)16.21
• Unsupervised Speech Representation Learning Using Wavenet Autoencoders (2019)17.21
• Improving Trajectory Modelling For Dnn-based Speech Synthesis By Using Stacked Bottleneck Features And Minimum Generation Error Training (2016)10.35
• An Unsupervised Autoregressive Model For Speech Representation Learning (2019)17.26
• Speech Denoising By Parametric Resynthesis (2019)7.16
• DQR-TTS: Semi-supervised Text-to-speech Synthesis With Dynamic Quantized Representation (2023)2.26
• Generative Adversarial Network-based Glottal Waveform Model For Statistical Parametric Speech Synthesis (2019)10.35
• Parallel Synthesis For Autoregressive Speech Generation (2022)4.52