Synth2aug: Cross-domain Speaker Recognition With TTS Synthesized Speech

Abstract

In recent years, Text-To-Speech (TTS) has been used as a data augmentation technique for speech recognition to help complement inadequacies in the training data. Correspondingly, we investigate the use of a multi-speaker TTS system to synthesize speech in support of speaker recognition. In this study we focus the analysis on tasks where a relatively small number of speakers is available for training. We observe on our datasets that TTS synthesized speech improves cross-domain speaker recognition performance and can be combined effectively with multi-style training. Additionally, we explore the effectiveness of different types of text transcripts used for TTS synthesis. Results suggest that matching the textual content of the target domain is a good practice, and if that is not feasible, a transcript with a sufficiently large vocabulary is recommended.

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keyhuang2020synth2aug

Related papers

• Speech Recognition With Augmented Synthesized Speech (2019)13.97
• Generating Synthetic Audio Data For Attention-based Speech Recognition Systems (2019)12.68
• Spoken Language Corpora Augmentation With Domain-specific Voice-cloned Speech (2024)0.00
• TDASS: Target Domain Adaptation Speech Synthesis Framework For Multi-speaker Low-resource TTS (2022)0.00
• ASR Data Augmentation In Low-resource Settings Using Cross-lingual Multi-speaker TTS And Cross-lingual Voice Conversion (2022)6.77
• Synthio: Augmenting Small-scale Audio Classification Datasets With Synthetic Data (2024)0.00
• Training Multi-speaker Neural Text-to-speech Systems Using Speaker-imbalanced Speech Corpora (2019)8.09
• Crossspeech: Speaker-independent Acoustic Representation For Cross-lingual Speech Synthesis (2023)7.16