Measuring The Effectiveness Of Voice Conversion On Speaker Identification And Automatic Speech Recognition Systems

Abstract

This paper evaluates the effectiveness of a Cycle-GAN based voice converter (VC) on four speaker identification (SID) systems and an automated speech recognition (ASR) system for various purposes. Audio samples converted by the VC model are classified by the SID systems as the intended target at up to 46% top-1 accuracy among more than 250 speakers. This encouraging result in imitating the target styles led us to investigate if converted (synthetic) samples can be used to improve ASR training. Unfortunately, adding synthetic data to the ASR training set only marginally improves word and character error rates. Our results indicate that even though VC models can successfully mimic the style of target speakers as measured by SID systems, improving ASR training with synthetic data from VC systems needs further research to establish its efficacy.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keykeskin2019measuring

Related papers

• Generative Adversarial Network Based Voice Conversion: Techniques, Challenges, And Recent Advancements (2025)0.00
• How Far Are We From Robust Voice Conversion: A Survey (2020)9.41
• Assem-vc: Realistic Voice Conversion By Assembling Modern Speech Synthesis Techniques (2021)11.64
• The NU Voice Conversion System For The Voice Conversion Challenge 2020: On The Effectiveness Of Sequence-to-sequence Models And Autoregressive Neural Vocoders (2020)3.58
• High-quality Nonparallel Voice Conversion Based On Cycle-consistent Adversarial Network (2018)0.00
• Application Of ASV For Voice Identification After VC And Duration Predictor Improvement In TTS Models (2024)0.00
• Voice Conversion Can Improve ASR In Very Low-resource Settings (2021)7.50
• A Comparative Study Of Self-supervised Speech Representation Based Voice Conversion (2022)9.76