CQNV: A Combination Of Coarsely Quantized Bitstream And Neural Vocoder For Low Rate Speech Coding

Abstract

Recently, speech codecs based on neural networks have proven to perform better than traditional methods. However, redundancy in traditional parameter quantization is visible within the codec architecture of combining the traditional codec with the neural vocoder. In this paper, we propose a novel framework named CQNV, which combines the coarsely quantized parameters of a traditional parametric codec to reduce the bitrate with a neural vocoder to improve the quality of the decoded speech. Furthermore, we introduce a parameters processing module into the neural vocoder to enhance the application of the bitstream of traditional speech coding parameters to the neural vocoder, further improving the reconstructed speech's quality. In the experiments, both subjective and objective evaluations demonstrate the effectiveness of the proposed CQNV framework. Specifically, our proposed method can achieve higher quality reconstructed speech at 1.1 kbps than Lyra and Encodec at 3 kbps.

Stats

• citations6
• S2 citations—
• github stars0
• HF likes0
• heat score6.34
• arxiv keyzheng2023cqnv

Related papers

• Efficient And Scalable Neural Residual Waveform Coding With Collaborative Quantization (2020)8.60
• Low Bit-rate Speech Coding With VQ-VAE And A Wavenet Decoder (2019)14.80
• Neural Speech Coding For Real-time Communications Using Constant Bitrate Scalar Quantization (2024)0.00
• Optimizing Neural Speech Codec For Low-bitrate Compression Via Multi-scale Encoding (2024)0.00
• Latent-domain Predictive Neural Speech Coding (2022)12.15
• Variable Bitrate Residual Vector Quantization For Audio Coding (2024)3.58
• NDVQ: Robust Neural Audio Codec With Normal Distribution-based Vector Quantization (2024)0.00
• ERVQ: Enhanced Residual Vector Quantization With Intra-and-inter-codebook Optimization For Neural Audio Codecs (2024)6.34