Utterance-level End-to-end Language Identification Using Attention-based CNN-BLSTM

Abstract

In this paper, we present an end-to-end language identification framework, the attention-based Convolutional Neural Network-Bidirectional Long-short Term Memory (CNN-BLSTM). The model is performed on the utterance level, which means the utterance-level decision can be directly obtained from the output of the neural network. To handle speech utterances with entire arbitrary and potentially long duration, we combine CNN-BLSTM model with a self-attentive pooling layer together. The front-end CNN-BLSTM module plays a role as local pattern extractor for the variable-length inputs, and the following self-attentive pooling layer is built on top to get the fixed-dimensional utterance-level representation. We conducted experiments on NIST LRE07 closed-set task, and the results reveal that the proposed attention-based CNN-BLSTM model achieves comparable error reduction with other state-of-the-art utterance-level neural network approaches for all 3 seconds, 10 seconds, 30 seconds duration tasks.

Stats

• citations35
• S2 citations—
• github stars0
• HF likes0
• heat score11.67
• arxiv keycai2019utterance

Related papers

• End-to-end Language Identification Using Multi-head Self-attention And 1D Convolutional Neural Networks (2021)0.00
• End-to-end Attention Based Text-dependent Speaker Verification (2017)14.87
• Attentive Temporal Pooling For Conformer-based Streaming Language Identification In Long-form Speech (2022)7.16
• Self Multi-head Attention For Speaker Recognition (2019)13.84
• Joint Language Identification Of Code-switching Speech Using Attention Based E2E Network (2019)5.24
• Language Identification With Deep Bottleneck Features (2018)0.00
• Towards Relevance And Sequence Modeling In Language Recognition (2020)9.23
• Is Attention Always Needed? A Case Study On Language Identification From Speech (2021)2.26