Symmetric Saliency-based Adversarial Attack To Speaker Identification

Abstract

Adversarial attack approaches to speaker identification either need high computational cost or are not very effective, to our knowledge. To address this issue, in this paper, we propose a novel generation-network-based approach, called symmetric saliency-based encoder-decoder (SSED), to generate adversarial voice examples to speaker identification. It contains two novel components. First, it uses a novel saliency map decoder to learn the importance of speech samples to the decision of a targeted speaker identification system, so as to make the attacker focus on generating artificial noise to the important samples. It also proposes an angular loss function to push the speaker embedding far away from the source speaker. Our experimental results demonstrate that the proposed SSED yields the state-of-the-art performance, i.e. over 97% targeted attack success rate and a signal-to-noise level of over 39 dB on both the open-set and close-set speaker identification tasks, with a low computatio

Stats

• citations13
• S2 citations—
• github stars0
• HF likes0
• heat score8.60
• arxiv keyyao2022symmetric

Related papers

• Pseudo-siamese Network Based Timbre-reserved Black-box Adversarial Attack In Speaker Identification (2023)0.00
• Diffattack: Diffusion-based Timbre-reserved Adversarial Attack In Speaker Identification (2025)0.00
• Inaudible Adversarial Perturbations For Targeted Attack In Speaker Recognition (2020)12.33
• Privacy-utility Balanced Voice De-identification Using Adversarial Examples (2022)0.00
• Adversarial Attack And Defense Strategies For Deep Speaker Recognition Systems (2020)13.39
• Recognition-synthesis Based Non-parallel Voice Conversion With Adversarial Learning (2020)0.00
• Adversarial Sample Detection For Speaker Verification By Neural Vocoders (2021)0.00
• Speaker De-identification System Using Autoencoders And Adversarial Training (2020)0.00