Joint Domain Adaptation And Speech Bandwidth Extension Using Time-domain Gans For Speaker Verification

Abstract

Speech systems developed for a particular choice of acoustic domain and sampling frequency do not translate easily to others. The usual practice is to learn domain adaptation and bandwidth extension models independently. Contrary to this, we propose to learn both tasks together. Particularly, we learn to map narrowband conversational telephone speech to wideband microphone speech. We developed parallel and non-parallel learning solutions which utilize both paired and unpaired data. First, we first discuss joint and disjoint training of multiple generative models for our tasks. Then, we propose a two-stage learning solution where we use a pre-trained domain adaptation system for pre-processing in bandwidth extension training. We evaluated our schemes on a Speaker Verification downstream task. We used the JHU-MIT experimental setup for NIST SRE21, which comprises SRE16, SRE-CTS Superset and SRE21. Our results provide the first evidence that learning both tasks is better than learning jus

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keykataria2022joint

Related papers

• Time-domain Speech Super-resolution With GAN Based Modeling For Telephony Speaker Verification (2022)5.24
• Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks (2024)0.00
• Single Channel Far Field Feature Enhancement For Speaker Verification In The Wild (2020)0.00
• Channel-aware Domain-adaptive Generative Adversarial Network For Robust Speech Recognition (2024)4.52
• Joint Speech And Overlap Detection: A Benchmark Over Multiple Audio Setup And Speech Domains (2023)0.00
• Channel Adaptation For Speaker Verification Using Optimal Transport With Pseudo Label (2024)0.00
• Generalized Domain Adaptation Framework For Parametric Back-end In Speaker Recognition (2023)0.00
• Speaker Verification Using End-to-end Adversarial Language Adaptation (2018)11.19