Analysis By Adversarial Synthesis -- A Novel Approach For Speech Vocoding

Abstract

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep generative models such as WaveNet and SampleRNN have been used as speech vocoders to scale up the perceptual quality of the reconstructed signals without increasing the coding rate. However, such models suffer from a very slow signal generation mechanism due to their sample-by-sample modelling approach. In this work, we introduce a new methodology for neural speech vocoding based on generative adversarial networks (GANs). A fake speech signal is generated from a very compressed representation of the glottal excitation using conditional GANs as a deep generative model. This fake speech is then refined using the LPC parameters of the original speech signal to obtain a natural reconstruction. The reconstructed speech waveforms based on this approach show

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keymustafa2019analysis

Related papers

• Expediting TTS Synthesis With Adversarial Vocoding (2019)6.77
• Generative Adversarial Network-based Glottal Waveform Model For Statistical Parametric Speech Synthesis (2019)10.35
• Statistical Parametric Speech Synthesis Incorporating Generative Adversarial Networks (2017)16.21
• End-to-end Video-to-speech Synthesis Using Generative Adversarial Networks (2021)11.58
• High Fidelity Speech Synthesis With Adversarial Networks (2019)0.00
• Waveform Generation For Text-to-speech Synthesis Using Pitch-synchronous Multi-scale Generative Adversarial Networks (2018)8.35
• Video-driven Speech Reconstruction Using Generative Adversarial Networks (2019)11.39
• A Comparison Of Recent Waveform Generation And Acoustic Modeling Methods For Neural-network-based Speech Synthesis (2018)11.76