RNN Based Incremental Online Spoken Language Understanding

Abstract

Spoken Language Understanding (SLU) typically comprises of an automatic speech recognition (ASR) followed by a natural language understanding (NLU) module. The two modules process signals in a blocking sequential fashion, i.e., the NLU often has to wait for the ASR to finish processing on an utterance basis, potentially leading to high latencies that render the spoken interaction less natural. In this paper, we propose recurrent neural network (RNN) based incremental processing towards the SLU task of intent detection. The proposed methodology offers lower latencies than a typical SLU system, without any significant reduction in system accuracy. We introduce and analyze different recurrent neural network architectures for incremental and online processing of the ASR transcripts and compare it to the existing offline systems. A lexical End-of-Sentence (EOS) detector is proposed for segmenting the stream of transcript into sentences for intent classification. Intent detection experiments

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyshivakumar2019rnn

Related papers

• Joint Online Spoken Language Understanding And Language Modeling With Recurrent Neural Networks (2016)13.28
• End-to-end Architectures For Asr-free Spoken Language Understanding (2019)8.60
• Recent Advances In End-to-end Spoken Language Understanding (2019)8.09
• Multi-task RNN-T With Semantic Decoder For Streamable Spoken Language Understanding (2022)4.52
• Integrating Pretrained ASR And LM To Perform Sequence Generation For Spoken Language Understanding (2023)5.24
• Speech-language Pre-training For End-to-end Spoken Language Understanding (2021)9.41
• Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding (2025)0.00
• Speech To Semantics: Improve ASR And NLU Jointly Via All-neural Interfaces (2020)9.03