Parallel Wavenet: Fast High-fidelity Speech Synthesis

Abstract

The recently-developed WaveNet architecture is the current state of the art in realistic speech synthesis, consistently rated as more natural sounding for many different languages than any previous system. However, because WaveNet relies on sequential generation of one audio sample at a time, it is poorly suited to today's massively parallel computers, and therefore hard to deploy in a real-time production setting. This paper introduces Probability Density Distillation, a new method for training a parallel feed-forward network from a trained WaveNet with no significant difference in quality. The resulting system is capable of generating high-fidelity speech samples at more than 20 times faster than real-time, and is deployed online by Google Assistant, including serving multiple English and Japanese voices.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyoord2017parallel

Related papers

• Wavenet: A Generative Model For Raw Audio (2016)0.00
• Parallel Wavegan: A Fast Waveform Generation Model Based On Generative Adversarial Networks With Multi-resolution Spectrogram (2019)0.00
• Probability Density Distillation With Generative Adversarial Networks For High-quality Parallel Waveform Generation (2019)10.48
• Lp-wavenet: Linear Prediction-based Wavenet Speech Synthesis (2018)0.00
• Parallel Wavenet Conditioned On VAE Latent Vectors (2020)0.00
• Flowavenet : A Generative Flow For Raw Audio (2018)0.00
• Efficient Neural Audio Synthesis (2018)0.00
• Generative Adversarial Network Based Speaker Adaptation For High Fidelity Wavenet Vocoder (2018)5.84