On Using 2D Sequence-to-sequence Models For Speech Recognition

Abstract

Attention-based sequence-to-sequence models have shown promising results in automatic speech recognition. Using these architectures, one-dimensional input and output sequences are related by an attention approach, thereby replacing more explicit alignment processes, like in classical HMM-based modeling. In contrast, here we apply a novel two-dimensional long short-term memory (2DLSTM) architecture to directly model the input/output relation between audio/feature vector sequences and word sequences. The proposed model is an alternative model such that instead of using any type of attention components, we apply a 2DLSTM layer to assimilate the context from both input observations and output transcriptions. The experimental evaluation on the Switchboard 300h automatic speech recognition task shows word error rates for the 2DLSTM model that are competitive to end-to-end attention-based model.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keybahar2019on

Related papers

• Single Headed Attention Based Sequence-to-sequence Model For State-of-the-art Results On Switchboard (2020)0.00
• Acoustic-to-word Recognition With Sequence-to-sequence Models (2018)6.77
• Towards Better Decoding And Language Model Integration In Sequence To Sequence Models (2016)15.67
• State-of-the-art Speech Recognition With Sequence-to-sequence Models (2017)21.01
• Supervised Attention In Sequence-to-sequence Models For Speech Recognition (2022)5.84
• High Performance Sequence-to-sequence Model For Streaming Speech Recognition (2020)3.58
• End-to-end Attention-based Distant Speech Recognition With Highway LSTM (2016)0.00
• Towards Relevance And Sequence Modeling In Language Recognition (2020)9.23