Combining Automatic Speaker Verification And Prosody Analysis For Synthetic Speech Detection

Abstract

The rapid spread of media content synthesis technology and the potentially damaging impact of audio and video deepfakes on people's lives have raised the need to implement systems able to detect these forgeries automatically. In this work we present a novel approach for synthetic speech detection, exploiting the combination of two high-level semantic properties of the human voice. On one side, we focus on speaker identity cues and represent them as speaker embeddings extracted using a state-of-the-art method for the automatic speaker verification task. On the other side, voice prosody, intended as variations in rhythm, pitch or accent in speech, is extracted through a specialized encoder. We show that the combination of these two embeddings fed to a supervised binary classifier allows the detection of deepfake speech generated with both Text-to-Speech and Voice Conversion techniques. Our results show improvements over the considered baselines, good generalization properties over multip

Stats

• citations24
• S2 citations—
• github stars0
• HF likes0
• heat score10.48
• arxiv keyattorresi2022combining

Related papers

• Securing Voice Biometrics: One-shot Learning Approach For Audio Deepfake Detection (2023)9.03
• Self-attention And Hybrid Features For Replay And Deep-fake Audio Detection (2024)0.00
• Pitch Imperfect: Detecting Audio Deepfakes Through Acoustic Prosodic Analysis (2025)0.00
• Robust Ai-synthesized Speech Detection Using Feature Decomposition Learning And Synthesizer Feature Augmentation (2024)8.35
• One-class Learning Towards Synthetic Voice Spoofing Detection (2020)17.31
• Detection Of Doctored Speech: Towards An End-to-end Parametric Learn-able Filter Approach (2022)0.00
• Safespeech: Robust And Universal Voice Protection Against Malicious Speech Synthesis (2025)0.00
• Defense Against Synthetic Speech: Real-time Detection Of RVC Voice Conversion Attacks (2025)0.00