Open-set Short Utterance Forensic Speaker Verification Using Teacher-student Network With Explicit Inductive Bias

Abstract

In forensic applications, it is very common that only small naturalistic datasets consisting of short utterances in complex or unknown acoustic environments are available. In this study, we propose a pipeline solution to improve speaker verification on a small actual forensic field dataset. By leveraging large-scale out-of-domain datasets, a knowledge distillation based objective function is proposed for teacher-student learning, which is applied for short utterance forensic speaker verification. The objective function collectively considers speaker classification loss, Kullback-Leibler divergence, and similarity of embeddings. In order to advance the trained deep speaker embedding network to be robust for a small target dataset, we introduce a novel strategy to fine-tune the pre-trained student model towards a forensic target domain by utilizing the model as a finetuning start point and a reference in regularization. The proposed approaches are evaluated on the 1st48-UTD forensic corp

Stats

• citations17
• S2 citations—
• github stars0
• HF likes0
• heat score9.41
• arxiv keysang2020open

Related papers

• Distilling Multi-level X-vector Knowledge For Small-footprint Speaker Verification (2023)0.00
• Short Utterance Compensation In Speaker Verification Via Cosine-based Teacher-student Learning Of Speaker Embeddings (2018)10.74
• Cross-domain Adaptation With Discrepancy Minimization For Text-independent Forensic Speaker Verification (2020)8.60
• Learning Metrics From Mean Teacher: A Supervised Learning Method For Improving The Generalization Of Speaker Verification System (2021)0.00
• Hiddenspeaker: Generate Imperceptible Unlearnable Audios For Speaker Verification System (2024)2.26
• Adapting End-to-end Neural Speaker Verification To New Languages And Recording Conditions With Adversarial Training (2018)9.59
• Multi-level Transfer Learning From Near-field To Far-field Speaker Verification (2021)0.00
• Joint Speaker Encoder And Neural Back-end Model For Fully End-to-end Automatic Speaker Verification With Multiple Enrollment Utterances (2022)0.00