H-VECTORS: Utterance-level Speaker Embedding Using A Hierarchical Attention Model

Abstract

In this paper, a hierarchical attention network to generate utterance-level embeddings (H-vectors) for speaker identification is proposed. Since different parts of an utterance may have different contributions to speaker identities, the use of hierarchical structure aims to learn speaker related information locally and globally. In the proposed approach, frame-level encoder and attention are applied on segments of an input utterance and generate individual segment vectors. Then, segment level attention is applied on the segment vectors to construct an utterance representation. To evaluate the effectiveness of the proposed approach, NIST SRE 2008 Part1 dataset is used for training, and two datasets, Switchboard Cellular part1 and CallHome American English Speech, are used to evaluate the quality of extracted utterance embeddings on speaker identification and verification tasks. In comparison with two baselines, X-vector, X-vector+Attention, the obtained results show that H-vectors can a

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyshi2019h

Related papers

• T-vectors: Weakly Supervised Speaker Identification Using Hierarchical Transformer Model (2020)0.00
• Weakly Supervised Training Of Hierarchical Attention Networks For Speaker Identification (2020)3.58
• Attention Mechanism In Speaker Recognition: What Does It Learn In Deep Speaker Embedding? (2018)8.60
• Multi-task Learning With High-order Statistics For X-vector Based Text-independent Speaker Verification (2019)8.35
• End-to-end Attention Based Text-dependent Speaker Verification (2017)14.87
• Self Multi-head Attention For Speaker Recognition (2019)13.84
• Deep Speaker Embedding Learning With Multi-level Pooling For Text-independent Speaker Verification (2019)0.00
• S-vectors And TESA: Speaker Embeddings And A Speaker Authenticator Based On Transformer Encoder (2020)11.08