A Hierarchical Decoding Model For Spoken Language Understanding From Unaligned Data

Abstract

Spoken language understanding (SLU) systems can be trained on two types of labelled data: aligned or unaligned. Unaligned data do not require word by word annotation and is easier to be obtained. In the paper, we focus on spoken language understanding from unaligned data whose annotation is a set of act-slot-value triples. Previous works usually focus on improve slot-value pair prediction and estimate dialogue act types separately, which ignores the hierarchical structure of the act-slot-value triples. Here, we propose a novel hierarchical decoding model which dynamically parses act, slot and value in a structured way and employs pointer network to handle out-of-vocabulary (OOV) values. Experiments on DSTC2 dataset, a benchmark unaligned dataset, show that the proposed model not only outperforms previous state-of-the-art model, but also can be generalized effectively and efficiently to unseen act-slot type pairs and OOV values.

Stats

• citations8
• S2 citations—
• github stars0
• HF likes0
• heat score7.16
• arxiv keyzhao2019a

Related papers

• Exploiting Sentence And Context Representations In Deep Neural Models For Spoken Language Understanding (2016)0.00
• Label-aware Multi-level Contrastive Learning For Cross-lingual Spoken Language Understanding (2022)6.34
• Unislu: Unified Spoken Language Understanding From Heterogeneous Cross-task Datasets (2025)0.00
• Speech-language Pre-training For End-to-end Spoken Language Understanding (2021)9.41
• Multi-domain Adversarial Learning For Slot Filling In Spoken Language Understanding (2017)0.00
• Data Augmentation For Spoken Language Understanding Via Pretrained Language Models (2020)0.00
• Token-level Sequence Labeling For Spoken Language Understanding Using Compositional End-to-end Models (2022)0.00
• Bridging The Gap Between Clean Data Training And Real-world Inference For Spoken Language Understanding (2021)0.00