Self-attention And Hybrid Features For Replay And Deep-fake Audio Detection

Abstract

Due to the successful application of deep learning, audio spoofing detection has made significant progress. Spoofed audio with speech synthesis or voice conversion can be well detected by many countermeasures. However, an automatic speaker verification system is still vulnerable to spoofing attacks such as replay or Deep-Fake audio. Deep-Fake audio means that the spoofed utterances are generated using text-to-speech (TTS) and voice conversion (VC) algorithms. Here, we propose a novel framework based on hybrid features with the self-attention mechanism. It is expected that hybrid features can be used to get more discrimination capacity. Firstly, instead of only one type of conventional feature, deep learning features and Mel-spectrogram features will be extracted by two parallel paths: convolution neural networks and a short-time Fourier transform (STFT) followed by Mel-frequency. Secondly, features will be concatenated by a max-pooling layer. Thirdly, there is a Self-attention mechanis

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhuang2024self

Related papers

• Securing Voice Biometrics: One-shot Learning Approach For Audio Deepfake Detection (2023)9.03
• Combining Automatic Speaker Verification And Prosody Analysis For Synthetic Speech Detection (2022)10.48
• Audio-replay Attack Detection Countermeasures (2017)6.34
• Continual Learning For Fake Audio Detection (2021)11.49
• Deep Residual Neural Networks For Audio Spoofing Detection (2019)0.00
• Adaptive Re-calibration Of Channel-wise Features For Adversarial Audio Classification (2022)0.00
• Automatic Speaker Verification Spoofing And Deepfake Detection Using Wav2vec 2.0 And Data Augmentation (2022)17.35
• One-class Learning Towards Synthetic Voice Spoofing Detection (2020)17.31