Dnn-free Low-latency Adaptive Speech Enhancement Based On Frame-online Beamforming Powered By Block-online Fastmnmf

Abstract

This paper describes a practical dual-process speech enhancement system that adapts environment-sensitive frame-online beamforming (front-end) with help from environment-free block-online source separation (back-end). To use minimum variance distortionless response (MVDR) beamforming, one may train a deep neural network (DNN) that estimates time-frequency masks used for computing the covariance matrices of sources (speech and noise). Backpropagation-based run-time adaptation of the DNN was proposed for dealing with the mismatched training-test conditions. Instead, one may try to directly estimate the source covariance matrices with a state-of-the-art blind source separation method called fast multichannel non-negative matrix factorization (FastMNMF). In practice, however, neither the DNN nor the FastMNMF can be updated in a frame-online manner due to its computationally-expensive iterative nature. Our DNN-free system leverages the posteriors of the latest source spectrograms given by b

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keynugraha2022dnn

Related papers

• Run-time Adaptation Of Neural Beamforming For Robust Speech Dereverberation And Denoising (2024)0.00
• Unsupervised Speech Enhancement Based On Multichannel Nmf-informed Beamforming For Noise-robust Automatic Speech Recognition (2019)13.23
• Block-online Multi-channel Speech Enhancement Using Dnn-supported Relative Transfer Function Estimates (2019)8.35
• ADL-MVDR: All Deep Learning MVDR Beamformer For Target Speech Separation (2020)15.00
• Multichannel Speech Enhancement Without Beamforming (2021)9.41
• Multichannel Loss Function For Supervised Speech Source Separation By Mask-based Beamforming (2019)7.50
• Sequential Multi-frame Neural Beamforming For Speech Separation And Enhancement (2019)0.00
• Deep Ad-hoc Beamforming (2018)9.59