All Information Is Necessary: Integrating Speech Positive And Negative Information By Contrastive Learning For Speech Enhancement
2023 · Xinmeng Xu, Weiping Tu, Chang Han, et al.
Abstract
Monaural speech enhancement (SE) is an ill-posed problem due to the irreversible degradation process. Recent methods to achieve SE tasks rely solely on positive information, e.g., ground-truth speech and speech-relevant features. Different from the above, we observe that the negative information, such as original speech mixture and speech-irrelevant features, are valuable to guide the SE model training procedure. In this study, we propose a SE model that integrates both speech positive and negative information for improving SE performance by adopting contrastive learning, in which two innovations have consisted. (1) We design a collaboration module (CM), which contains two parts, contrastive attention for separating relevant and irrelevant features via contrastive learning and interactive attention for establishing the correlation between both speech features in a learnable and self-adaptive manner. (2) We propose a contrastive regularization (CR) built upon contrastive learning to ens
Authors
(none)
Tags
Stats
Related papers
- Joint Training Of Speech Enhancement And Self-supervised Model For Noise-robust ASR (2022)0.00
- Toward Universal Speech Enhancement For Diverse Input Conditions (2023)0.00
- Human Listening And Live Captioning: Multi-task Training For Speech Enhancement (2021)9.92
- Reinforcement Learning Based Speech Enhancement For Robust Speech Recognition (2018)11.08
- Restorative Speech Enhancement: A Progressive Approach Using SE And Codec Modules (2024)0.00
- Bridging The Gap: Integrating Pre-trained Speech Enhancement And Recognition Models For Robust Speech Recognition (2024)7.50
- CLN-VC: Text-free Voice Conversion Based On Fine-grained Style Control And Contrastive Learning With Negative Samples Augmentation (2023)2.26
- A Study Of Incorporating Articulatory Movement Information In Speech Enhancement (2020)0.00