Consistency-aware Multi-channel Speech Enhancement Using Deep Neural Networks

Abstract

This paper proposes a deep neural network (DNN)-based multi-channel speech enhancement system in which a DNN is trained to maximize the quality of the enhanced time-domain signal. DNN-based multi-channel speech enhancement is often conducted in the time-frequency (T-F) domain because spatial filtering can be efficiently implemented in the T-F domain. In such a case, ordinary objective functions are computed on the estimated T-F mask or spectrogram. However, the estimated spectrogram is often inconsistent, and its amplitude and phase may change when the spectrogram is converted back to the time-domain. That is, the objective function does not evaluate the enhanced time-domain signal properly. To address this problem, we propose to use an objective function defined on the reconstructed time-domain signal. Specifically, speech enhancement is conducted by multi-channel Wiener filtering in the T-F domain, and its result is converted back to the time-domain. We propose two objective function

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymasuyama2020consistency

Related papers

• On The Role Of Spatial, Spectral, And Temporal Processing For Dnn-based Non-linear Multi-channel Speech Enhancement (2022)7.81
• Insights Into Deep Non-linear Filters For Improved Multi-channel Speech Enhancement (2022)13.93
• Deep Interaction Between Masking And Mapping Targets For Single-channel Speech Enhancement (2021)0.00
• On The Importance Of Neural Wiener Filter For Resource Efficient Multichannel Speech Enhancement (2024)0.00
• Multi-modal Hybrid Deep Neural Network For Speech Enhancement (2016)0.00
• Multi-channel End-to-end Neural Network For Speech Enhancement, Source Localization, And Voice Activity Detection (2022)0.00
• Invertible Dnn-based Nonlinear Time-frequency Transform For Speech Enhancement (2019)7.16
• Monaural Speech Enhancement Using Deep Neural Networks By Maximizing A Short-time Objective Intelligibility Measure (2018)11.76