Fusion Of Embeddings Networks For Robust Combination Of Text Dependent And Independent Speaker Recognition

Abstract

By implicitly recognizing a user based on his/her speech input, speaker identification enables many downstream applications, such as personalized system behavior and expedited shopping checkouts. Based on whether the speech content is constrained or not, both text-dependent (TD) and text-independent (TI) speaker recognition models may be used. We wish to combine the advantages of both types of models through an ensemble system to make more reliable predictions. However, any such combined approach has to be robust to incomplete inputs, i.e., when either TD or TI input is missing. As a solution we propose a fusion of embeddings network foenet architecture, combining joint learning with neural attention. We compare foenet with four competitive baseline methods on a dataset of voice assistant inputs, and show that it achieves higher accuracy than the baseline and score fusion methods, especially in the presence of incomplete inputs.

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyli2021fusion

Related papers

• Attentive Fusion Enhanced Audio-visual Encoding For Transformer Based Robust Speech Recognition (2020)0.00
• Attention-based Audio-visual Fusion For Robust Automatic Speech Recognition (2018)16.67
• A Novel Speech Feature Fusion Algorithm For Text-independent Speaker Recognition (2022)3.58
• Speaker Verification In Multi-speaker Environments Using Temporal Feature Fusion (2022)0.00
• Robust Audio-visual Target Speaker Extraction With Emotion-aware Multiple Enrollment Fusion (2025)0.00
• Unified Hypersphere Embedding For Speaker Recognition (2018)0.00
• Leveraging Redundancy In Multiple Audio Signals For Far-field Speech Recognition (2023)0.00
• Unet-based Fusion And Exponential Moving Average Adaptation For Noise-robust Speaker Recognition (2026)0.00