Snr-progressive Model With Harmonic Compensation For Low-snr Speech Enhancement

Abstract

Despite significant progress made in the last decade, deep neural network (DNN) based speech enhancement (SE) still faces the challenge of notable degradation in the quality of recovered speech under low signal-to-noise ratio (SNR) conditions. In this letter, we propose an SNR-progressive speech enhancement model with harmonic compensation for low-SNR SE. Reliable pitch estimation is obtained from the intermediate output, which has the benefit of retaining more speech components than the coarse estimate while possessing a significant higher SNR than the input noisy speech. An effective harmonic compensation mechanism is introduced for better harmonic recovery. Extensive ex-periments demonstrate the advantage of our proposed model. A multi-modal speech extraction system based on the proposed backbone model ranks first in the ICASSP 2024 MISP Challenge: https://mispchallenge.github.io/mispchallenge2023/index.html.

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyhou2024snr

Related papers

• Restorative Speech Enhancement: A Progressive Approach Using SE And Codec Modules (2024)0.00
• Progressive Speech Enhancement With Residual Connections (2019)5.24
• Convolutional Recurrent Neural Network Based Progressive Learning For Monaural Speech Enhancement (2019)0.00
• A Two-stage Full-band Speech Enhancement Model With Effective Spectral Compression Mapping (2022)0.00
• Speech Enhancement In Adverse Environments Based On Non-stationary Noise-driven Spectral Subtraction And Snr-dependent Phase Compensation (2018)0.00
• Reinforcement Learning Based Speech Enhancement For Robust Speech Recognition (2018)11.08
• High Fidelity Speech Enhancement With Band-split RNN (2022)0.00
• Multi-modal Hybrid Deep Neural Network For Speech Enhancement (2016)0.00