Rsknet-mtsp: Effective And Portable Deep Architecture For Speaker Verification

Abstract

The convolutional neural network (CNN) based approaches have shown great success for speaker verification (SV) tasks, where modeling long temporal context and reducing information loss of speaker characteristics are two important challenges significantly affecting the verification performance. Previous works have introduced dilated convolution and multi-scale aggregation methods to address above challenges. However, such methods are also hard to make full use of some valuable information, which make it difficult to substantially improve the verification performance. To address above issues, we construct a novel CNN-based architecture for SV, called RSKNet-MTSP, where a residual selective kernel block (RSKBlock) and a multiple time-scale statistics pooling (MTSP) module are first proposed. The RSKNet-MTSP can capture both long temporal context and neighbouring information, and gather more speaker-discriminative information from multi-scale features. In order to design a portable model f

Stats

• citations15
• S2 citations—
• github stars0
• HF likes0
• heat score9.03
• arxiv keywu2021rsknet

Related papers

• Speakernet: 1D Depth-wise Separable Convolutional Network For Text-independent Speaker Recognition And Verification (2020)0.00
• Next-tdnn: Modernizing Multi-scale Temporal Convolution Backbone For Speaker Verification (2023)10.07
• Frequency And Multi-scale Selective Kernel Attention For Speaker Verification (2022)10.07
• A Unified Deep Learning Framework For Short-duration Speaker Verification In Adverse Environments (2020)9.41
• An Improved Deep Neural Network For Modeling Speaker Characteristics At Different Temporal Scales (2020)6.34
• Speaker Verification Using Convolutional Neural Networks (2018)0.00
• Speechnas: Towards Better Trade-off Between Latency And Accuracy For Large-scale Speaker Verification (2021)9.76
• How To Leverage Dnn-based Speech Enhancement For Multi-channel Speaker Verification? (2022)0.00