Towards Parametric Speech Synthesis Using Gaussian-markov Model Of Spectral Envelope And Wavelet-based Decomposition Of F0

Abstract

Neural network-based Text-to-Speech has significantly improved the quality of synthesized speech. Prominent methods (e.g., Tacotron2, FastSpeech, FastPitch) usually generate Mel-spectrogram from text and then synthesize speech using vocoder (e.g., WaveNet, WaveGlow, HiFiGAN). Compared with traditional parametric approaches (e.g., STRAIGHT and WORLD), neural vocoder based end-to-end models suffer from slow inference speed, and the synthesized speech is usually not robust and lack of controllability. In this work, we propose a novel updated vocoder, which is a simple signal model to train and easy to generate waveforms. We use the Gaussian-Markov model toward robust learning of spectral envelope and wavelet-based statistical signal processing to characterize and decompose F0 features. It can retain the fine spectral envelope and achieve high controllability of natural speech. The experimental results demonstrate that our proposed vocoder achieves better naturalness of reconstructed speec

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyalradhi2022towards

Related papers

• Generative Adversarial Network-based Glottal Waveform Model For Statistical Parametric Speech Synthesis (2019)10.35
• Continuous Wavelet Vocoder-based Decomposition Of Parametric Speech Waveform Synthesis (2021)0.00
• Fastspeech: Fast, Robust And Controllable Text To Speech (2019)0.00
• Speech Denoising By Parametric Resynthesis (2019)7.16
• Parametric Resynthesis With Neural Vocoders (2019)8.60
• GELP: Gan-excited Linear Prediction For Speech Synthesis From Mel-spectrogram (2019)10.74
• A Comparison Of Recent Waveform Generation And Acoustic Modeling Methods For Neural-network-based Speech Synthesis (2018)11.76
• Speaker Independence Of Neural Vocoders And Their Effect On Parametric Resynthesis Speech Enhancement (2019)6.34