Rawnext: Speaker Verification System For Variable-duration Utterances With Deep Layer Aggregation And Extended Dynamic Scaling Policies

Abstract

Despite achieving satisfactory performance in speaker verification using deep neural networks, variable-duration utterances remain a challenge that threatens the robustness of systems. To deal with this issue, we propose a speaker verification system called RawNeXt that can handle input raw waveforms of arbitrary length by employing the following two components: (1) A deep layer aggregation strategy enhances speaker information by iteratively and hierarchically aggregating features of various time scales and spectral channels output from blocks. (2) An extended dynamic scaling policy flexibly processes features according to the length of the utterance by selectively merging the activations of different resolution branches in each block. Owing to these two components, our proposed model can extract speaker embeddings rich in time-spectral information and operate dynamically on length variations. Experimental results on the VoxCeleb1 test set consisting of various duration utterances dem

Stats

• citations17
• S2 citations—
• github stars25
• HF likes0
• heat score12.24
• arxiv keykim2021rawnext

Related papers

• Mr-rawnet: Speaker Verification System With Multiple Temporal Resolutions For Variable Duration Utterances Using Raw Waveforms (2024)2.26
• Improved Rawnet With Feature Map Scaling For Text-independent Speaker Verification Using Raw Waveforms (2020)14.15
• Rawnet: Advanced End-to-end Deep Neural Network Using Raw Waveforms For Text-independent Speaker Verification (2019)15.34
• Eres2netv2: Boosting Short-duration Speaker Verification Performance With Computational Efficiency (2024)9.41
• A Unified Deep Learning Framework For Short-duration Speaker Verification In Adverse Environments (2020)9.41
• Utterance-level Aggregation For Speaker Recognition In The Wild (2019)0.00
• Segment Aggregation For Short Utterances Speaker Verification Using Raw Waveforms (2020)0.00
• Improving Multi-scale Aggregation Using Feature Pyramid Module For Robust Speaker Verification Of Variable-duration Utterances (2020)10.48