Language-independent Speaker Anonymization Approach Using Self-supervised Pre-trained Models

Abstract

Speaker anonymization aims to protect the privacy of speakers while preserving spoken linguistic information from speech. Current mainstream neural network speaker anonymization systems are complicated, containing an F0 extractor, speaker encoder, automatic speech recognition acoustic model (ASR AM), speech synthesis acoustic model and speech waveform generation model. Moreover, as an ASR AM is language-dependent, trained on English data, it is hard to adapt it into another language. In this paper, we propose a simpler self-supervised learning (SSL)-based method for language-independent speaker anonymization without any explicit language-dependent model, which can be easily used for other languages. Extensive experiments were conducted on the VoicePrivacy Challenge 2020 datasets in English and AISHELL-3 datasets in Mandarin to demonstrate the effectiveness of our proposed SSL-based language-independent speaker anonymization method.

Stats

• citations20
• S2 citations—
• github stars0
• HF likes0
• heat score9.92
• arxiv keymiao2022language

Related papers

• Reprogramming Self-supervised Learning-based Speech Representations For Speaker Anonymization (2023)2.26
• Analyzing Language-independent Speaker Anonymization Framework Under Unseen Conditions (2022)8.09
• Speaker Anonymization Using Neural Audio Codec Language Models (2023)10.97
• Distinctive And Natural Speaker Anonymization Via Singular Value Transformation-assisted Matrix (2024)8.82
• SALT: Distinguishable Speaker Anonymization Through Latent Space Transformation (2023)9.88
• MUSA: Multi-lingual Speaker Anonymization Via Serial Disentanglement (2024)0.00
• On-device Speaker Anonymization Of Acoustic Embeddings For ASR Based Onflexible Location Gradient Reversal Layer (2023)0.00
• Speaker Anonymization Using X-vector And Neural Waveform Models (2019)0.00