Target Speech Extraction: Independent Vector Extraction Guided By Supervised Speaker Identification

Abstract

This manuscript proposes a novel robust procedure for the extraction of a speaker of interest (SOI) from a mixture of audio sources. The estimation of the SOI is performed via independent vector extraction (IVE). Since the blind IVE cannot distinguish the target source by itself, it is guided towards the SOI via frame-wise speaker identification based on deep learning. Still, an incorrect speaker can be extracted due to guidance failings, especially when processing challenging data. To identify such cases, we propose a criterion for non-intrusively assessing the estimated speaker. It utilizes the same model as the speaker identification, so no additional training is required. When incorrect extraction is detected, we propose a ``deflation'' step in which the incorrect source is subtracted from the mixture and, subsequently, another attempt to extract the SOI is performed. The process is repeated until successful extraction is achieved. The proposed procedure is experimentally tested on

Stats

• citations11
• S2 citations—
• github stars0
• HF likes0
• heat score8.09
• arxiv keymalek2021target

Related papers

• Adaptive Blind Audio Source Extraction Supervised By Dominant Speaker Identification Using X-vectors (2019)0.00
• Target Speech Extraction Based On Blind Source Separation And X-vector-based Speaker Selection Trained With Data Augmentation (2020)0.00
• New Insights On Target Speaker Extraction (2022)0.00
• USEV: Universal Speaker Extraction With Visual Cue (2021)12.17
• Imaginenet: Target Speaker Extraction With Intermittent Visual Cue Through Embedding Inpainting (2022)7.16
• Target Confusion In End-to-end Speaker Extraction: Analysis And Approaches (2022)9.59
• Weakly Supervised Training Of Speaker Identification Models (2018)5.84
• Discriminatively Re-trained I-vector Extractor For Speaker Recognition (2018)5.84