On The Use Of External Data For Spoken Named Entity Recognition

Abstract

Spoken language understanding (SLU) tasks involve mapping from speech audio signals to semantic labels. Given the complexity of such tasks, good performance might be expected to require large labeled datasets, which are difficult to collect for each new task and domain. However, recent advances in self-supervised speech representations have made it feasible to consider learning SLU models with limited labeled data. In this work we focus on low-resource spoken named entity recognition (NER) and address the question: Beyond self-supervised pre-training, how can we use external speech and/or text data that are not annotated for the task? We draw on a variety of approaches, including self-training, knowledge distillation, and transfer learning, and consider their applicability to both end-to-end models and pipeline (speech recognition followed by text NER model) approaches. We find that several of these approaches improve performance in resource-constrained settings beyond the benefits fro

Stats

• citations7
• S2 citations—
• github stars0
• HF likes0
• heat score6.77
• arxiv keypasad2021on

Related papers

• End-to-end Model For Named Entity Recognition From Speech Without Paired Training Data (2022)6.77
• Towards Reducing The Need For Speech Training Data To Build Spoken Language Understanding Systems (2022)8.35
• End-to-end Named Entity Extraction From Speech (2018)0.00
• Large-scale Transfer Learning For Low-resource Spoken Language Understanding (2020)2.26
• A Study On The Integration Of Pre-trained SSL, ASR, LM And SLU Models For Spoken Language Understanding (2022)8.09
• Recent Advances In End-to-end Spoken Language Understanding (2019)8.09
• Unsupervised Transfer Learning For Spoken Language Understanding In Intelligent Agents (2018)0.00
• Leveraging Cross-lingual Transfer Learning In Spoken Named Entity Recognition Systems (2023)0.00