Predictions Of Subjective Ratings And Spoofing Assessments Of Voice Conversion Challenge 2020 Submissions

Abstract

The Voice Conversion Challenge 2020 is the third edition under its flagship that promotes intra-lingual semiparallel and cross-lingual voice conversion (VC). While the primary evaluation of the challenge submissions was done through crowd-sourced listening tests, we also performed an objective assessment of the submitted systems. The aim of the objective assessment is to provide complementary performance analysis that may be more beneficial than the time-consuming listening tests. In this study, we examined five types of objective assessments using automatic speaker verification (ASV), neural speaker embeddings, spoofing countermeasures, predicted mean opinion scores (MOS), and automatic speech recognition (ASR). Each of these objective measures assesses the VC output along different aspects. We observed that the correlations of these objective assessments with the subjective results were high for ASV, neural speaker embedding, and ASR, which makes them more influential for predicting

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keydas2020predictions

Related papers

• Voice Conversion Challenge 2020: Intra-lingual Semi-parallel And Cross-lingual Voice Conversion (2020)12.74
• A Spoofing Benchmark For The 2018 Voice Conversion Challenge: Leveraging From Spoofing Countermeasures For Speech Artifact Assessment (2018)8.09
• The Voice Conversion Challenge 2018: Promoting Development Of Parallel And Nonparallel Methods (2018)17.06
• Mosnet: Deep Learning Based Objective Assessment For Voice Conversion (2019)16.90
• The Voicemos Challenge 2023: Zero-shot Subjective Speech Quality Prediction For Multiple Domains (2023)11.19
• Measuring The Effectiveness Of Voice Conversion On Speaker Identification And Automatic Speech Recognition Systems (2019)0.00
• Evaluation Of The Speech Resynthesis Capabilities Of The Voiceprivacy Challenge Baseline B1 (2023)3.58
• An Overview Of Voice Conversion And Its Challenges: From Statistical Modeling To Deep Learning (2020)18.53