Neural Speech And Audio Coding: Modern AI Technology Meets Traditional Codecs

Abstract

This paper explores the integration of model-based and data-driven approaches within the realm of neural speech and audio coding systems. It highlights the challenges posed by the subjective evaluation processes of speech and audio codecs and discusses the limitations of purely data-driven approaches, which often require inefficiently large architectures to match the performance of model-based methods. The study presents hybrid systems as a viable solution, offering significant improvements to the performance of conventional codecs through meticulously chosen design enhancements. Specifically, it introduces a neural network-based signal enhancer designed to post-process existing codecs' output, along with the autoencoder-based end-to-end models and LPCNet--hybrid systems that combine linear predictive coding (LPC) with neural networks. Furthermore, the paper delves into predictive models operating within custom feature spaces (TF-Codec) or predefined transform domains (MDCTNet) and exa

Stats

• citations8
• S2 citations—
• github stars0
• HF likes0
• heat score7.16
• arxiv keykim2024neural

Related papers

• Modeling Strategies For Speech Enhancement In The Latent Space Of A Neural Audio Codec (2025)0.00
• Investigating Neural Audio Codecs For Speech Language Model-based Speech Generation (2024)2.26
• Code Drift: Towards Idempotent Neural Audio Codecs (2024)2.26
• A Neural Speech Codec For Noise Robust Speech Coding (2023)0.00
• Latent-domain Predictive Neural Speech Coding (2022)12.15
• Neural Feature Predictor And Discriminative Residual Coding For Low-bitrate Speech Coding (2022)6.77
• Optimizing Neural Speech Codec For Low-bitrate Compression Via Multi-scale Encoding (2024)0.00
• Pscodec: A Series Of High-fidelity Low-bitrate Neural Speech Codecs Leveraging Prompt Encoders (2024)0.00