Representation Selective Self-distillation And Wav2vec 2.0 Feature Exploration For Spoof-aware Speaker Verification

Abstract

Text-to-speech and voice conversion studies are constantly improving to the extent where they can produce synthetic speech almost indistinguishable from bona fide human speech. In this regard, the importance of countermeasures (CM) against synthetic voice attacks of the automatic speaker verification (ASV) systems emerges. Nonetheless, most end-to-end spoofing detection networks are black-box systems, and the answer to what is an effective representation for finding artifacts remains veiled. In this paper, we examine which feature space can effectively represent synthetic artifacts using wav2vec 2.0, and study which architecture can effectively utilize the space. Our study allows us to analyze which attribute of speech signals is advantageous for the CM systems. The proposed CM system achieved 0.31% equal error rate (EER) on ASVspoof 2019 LA evaluation set for the spoof detection task. We further propose a simple yet effective spoofing aware speaker verification (SASV) method, which ta

Stats

• citations15
• S2 citations—
• github stars0
• HF likes0
• heat score9.03
• arxiv keylee2022representation

Related papers

• Experimental Study: Enhancing Voice Spoofing Detection Models With Wav2vec 2.0 (2024)0.00
• Automatic Speaker Verification Spoofing And Deepfake Detection Using Wav2vec 2.0 And Data Augmentation (2022)17.35
• Anti-spoofing Methods For Automatic Speakerverification System (2017)2.26
• Toward Improving Synthetic Audio Spoofing Detection Robustness Via Meta-learning And Disentangled Training With Adversarial Examples (2024)6.77
• Evince The Artifacts Of Spoof Speech By Blending Vocal Tract And Voice Source Features (2022)0.00
• Spoofing-aware Attention Based ASV Back-end With Multiple Enrollment Utterances And A Sampling Strategy For The SASV Challenge 2022 (2022)4.52
• One-class Learning Towards Synthetic Voice Spoofing Detection (2020)17.31
• Baseline Systems For The First Spoofing-aware Speaker Verification Challenge: Score And Embedding Fusion (2022)6.77