Deep Multi-frame MVDR Filtering For Single-microphone Speech Enhancement

Abstract

Multi-frame algorithms for single-microphone speech enhancement, e.g., the multi-frame minimum variance distortionless response (MFMVDR) filter, are able to exploit speech correlation across adjacent time frames in the short-time Fourier transform (STFT) domain. Provided that accurate estimates of the required speech interframe correlation vector and the noise correlation matrix are available, it has been shown that the MFMVDR filter yields a substantial noise reduction while hardly introducing any speech distortion. Aiming at merging the speech enhancement potential of the MFMVDR filter and the estimation capability of temporal convolutional networks (TCNs), in this paper we propose to embed the MFMVDR filter within a deep learning framework. The TCNs are trained to map the noisy speech STFT coefficients to the required quantities by minimizing the scale-invariant signal-to-distortion ratio loss function at the MFMVDR filter output. Experimental results show that the proposed deep MFM

Stats

• citations15
• S2 citations—
• github stars0
• HF likes0
• heat score9.03
• arxiv keytammen2020deep

Related papers

• Multi-channel Multi-frame ADL-MVDR For Target Speech Separation (2020)0.00
• Dnn-based Speech Presence Probability Estimation For Multi-frame Single-microphone Speech Enhancement (2019)8.82
• Unsupervised Speech Enhancement Based On Multichannel Nmf-informed Beamforming For Noise-robust Automatic Speech Recognition (2019)13.23
• Insights Into Deep Non-linear Filters For Improved Multi-channel Speech Enhancement (2022)13.93
• Narrow-band Deep Filtering For Multichannel Speech Enhancement (2019)0.00
• ADL-MVDR: All Deep Learning MVDR Beamformer For Target Speech Separation (2020)15.00
• Multichannel Speech Enhancement Without Beamforming (2021)9.41
• FB-MSTCN: A Full-band Single-channel Speech Enhancement Method Based On Multi-scale Temporal Convolutional Network (2022)6.77