Focus On The Sound Around You: Monaural Target Speaker Extraction Via Distance And Speaker Information
2023 · Jiuxin Lin, Peng Wang, Heinrich Dinkel, et al.
Abstract
Previously, Target Speaker Extraction (TSE) has yielded outstanding performance in certain application scenarios for speech enhancement and source separation. However, obtaining auxiliary speaker-related information is still challenging in noisy environments with significant reverberation. inspired by the recently proposed distance-based sound separation, we propose the near sound (NS) extractor, which leverages distance information for TSE to reliably extract speaker information without requiring previous speaker enrolment, called speaker embedding self-enrollment (SESE). Full- & sub-band modeling is introduced to enhance our NS-Extractor's adaptability towards environments with significant reverberation. Experimental results on several cross-datasets demonstrate the effectiveness of our improvements and the excellent performance of our proposed NS-Extractor in different application scenarios.
Authors
(none)
Tags
Stats
Related papers
- New Insights On Target Speaker Extraction (2022)0.00
- 3S-TSE: Efficient Three-stage Target Speaker Extraction For Real-time And Low-resource Applications (2023)5.24
- X-crossnet: A Complex Spectral Mapping Approach To Target Speaker Extraction With Cross Attention Speaker Embedding Fusion (2024)0.00
- USEF-TSE: Universal Speaker Embedding Free Target Speaker Extraction (2024)11.88
- Single Microphone Speaker Extraction Using Unified Time-frequency Siamese-unet (2022)3.58
- Target Speaker Extraction By Directly Exploiting Contextual Information In The Time-frequency Domain (2024)9.59
- A Two-stage Speaker Extraction Algorithm Under Adverse Acoustic Conditions Using A Single-microphone (2023)0.00
- Target Confusion In End-to-end Speaker Extraction: Analysis And Approaches (2022)9.59