Where Are We In Semantic Concept Extraction For Spoken Language Understanding?

Abstract

Spoken language understanding (SLU) topic has seen a lot of progress these last three years, with the emergence of end-to-end neural approaches. Spoken language understanding refers to natural language processing tasks related to semantic extraction from speech signal, like named entity recognition from speech or slot filling task in a context of human-machine dialogue. Classically, SLU tasks were processed through a cascade approach that consists in applying, firstly, an automatic speech recognition process, followed by a natural language processing module applied to the automatic transcriptions. These three last years, end-to-end neural approaches, based on deep neural networks, have been proposed in order to directly extract the semantics from speech signal, by using a single neural model. More recent works on self-supervised training with unlabeled data open new perspectives in term of performance for automatic speech recognition and natural language processing. In this paper, we p

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keyghannay2021where

Related papers

• Recent Advances In End-to-end Spoken Language Understanding (2019)8.09
• End-to-end Architectures For Asr-free Spoken Language Understanding (2019)8.60
• Speech-language Pre-training For End-to-end Spoken Language Understanding (2021)9.41
• Understanding Semantics From Speech Through Pre-training (2019)0.00
• Towards End-to-end Spoken Language Understanding (2018)14.73
• Speech To Semantics: Improve ASR And NLU Jointly Via All-neural Interfaces (2020)9.03
• End-to-end Model For Named Entity Recognition From Speech Without Paired Training Data (2022)6.77
• End-to-end Spoken Language Understanding: Performance Analyses Of A Voice Command Task In A Low Resource Setting (2022)8.35