Simple Attention Module Based Speaker Verification With Iterative Noisy Label Detection

Abstract

Recently, the attention mechanism such as squeeze-and-excitation module (SE) and convolutional block attention module (CBAM) has achieved great success in deep learning-based speaker verification system. This paper introduces an alternative effective yet simple one, i.e., simple attention module (SimAM), for speaker verification. The SimAM module is a plug-and-play module without extra modal parameters. In addition, we propose a noisy label detection method to iteratively filter out the data samples with a noisy label from the training data, considering that a large-scale dataset labeled with human annotation or other automated processes may contain noisy labels. Data with the noisy label may over parameterize a deep neural network (DNN) and result in a performance drop due to the memorization effect of the DNN. Experiments are conducted on VoxCeleb dataset. The speaker verification model with SimAM achieves the 0.675% equal error rate (EER) on VoxCeleb1 original test trials. Our propo

Stats

• citations57
• S2 citations—
• github stars0
• HF likes0
• heat score13.23
• arxiv keyqin2021simple

Related papers

• Speaker Verification Using Attentive Multi-scale Convolutional Recurrent Network (2023)0.00
• Multi-frequency Information Enhanced Channel Attention Module For Speaker Representation Learning (2022)0.00
• Frequency And Temporal Convolutional Attention For Text-independent Speaker Recognition (2019)0.00
• Attention Back-end For Automatic Speaker Verification With Multiple Enrollment Utterances (2021)10.21
• Convolution-based Channel-frequency Attention For Text-independent Speaker Verification (2022)7.50
• End-to-end Attention Based Text-dependent Speaker Verification (2017)14.87
• Double Multi-head Attention For Speaker Verification (2020)8.09
• Self Multi-head Attention For Speaker Recognition (2019)13.84