Deep Vocoder: Low Bit Rate Compression Of Speech With Deep Autoencoder

Abstract

Inspired by the success of deep neural networks (DNNs) in speech processing, this paper presents Deep Vocoder, a direct end-to-end low bit rate speech compression method with deep autoencoder (DAE). In Deep Vocoder, DAE is used for extracting the latent representing features (LRFs) of speech, which are then efficiently quantized by an analysis-by-synthesis vector quantization (AbS VQ) method. AbS VQ aims to minimize the perceptual spectral reconstruction distortion rather than the distortion of LRFs vector itself. Also, a suboptimal codebook searching technique is proposed to further reduce the computational complexity. Experimental results demonstrate that Deep Vocoder yields substantial improvements in terms of frequency-weighted segmental SNR, STOI and PESQ score when compared to the output of the conventional SQ- or VQ-based codec. The yielded PESQ score over the TIMIT corpus is 3.34 and 3.08 for speech coding at 2400 bit/s and 1200 bit/s, respectively.

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keymin2019deep

Related papers

• Low Bit-rate Speech Coding With VQ-VAE And A Wavenet Decoder (2019)14.80
• Low Bit-rate Wideband Speech Coding: A Deep Generative Model Based Approach (2021)0.00
• Empirical Evaluation Of Deep Learning Model Compression Techniques On The Wavenet Vocoder (2020)0.00
• Enhancing Into The Codec: Noise Robust Speech Coding With Vector-quantized Autoencoders (2021)10.21
• CQNV: A Combination Of Coarsely Quantized Bitstream And Neural Vocoder For Low Rate Speech Coding (2023)6.34
• Latent-domain Predictive Neural Speech Coding (2022)12.15
• VQVC+: One-shot Voice Conversion By Vector Quantization And U-net Architecture (2020)13.34
• DRED: Deep Redundancy Coding Of Speech Using A Rate-distortion-optimized Variational Autoencoder (2022)4.52