An Adversarial Learning Based Multi-step Spoken Language Understanding System Through Human-computer Interaction

Abstract

Most of the existing spoken language understanding systems can perform only semantic frame parsing based on a single-round user query. They cannot take users' feedback to update/add/remove slot values through multiround interactions with users. In this paper, we introduce a novel multi-step spoken language understanding system based on adversarial learning that can leverage the multiround user's feedback to update slot values. We perform two experiments on the benchmark ATIS dataset and demonstrate that the new system can improve parsing performance by at least \(2.5%\) in terms of F1, with only one round of feedback. The improvement becomes even larger when the number of feedback rounds increases. Furthermore, we also compare the new system with state-of-the-art dialogue state tracking systems and demonstrate that the new interactive system can perform better on multiround spoken language understanding tasks in terms of slot- and sentence-level accuracy.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywang2021an

Related papers

• Towards End-to-end Spoken Language Understanding (2018)14.73
• ML-LMCL: Mutual Learning And Large-margin Contrastive Learning For Improving ASR Robustness In Spoken Language Understanding (2023)0.00
• Data-centric Improvements For Enhancing Multi-modal Understanding In Spoken Conversation Modeling (2024)0.00
• Multimodal Audio-textual Architecture For Robust Spoken Language Understanding (2023)0.00
• Adapting A Framenet Semantic Parser For Spoken Language Understanding Using Adversarial Learning (2019)2.26
• Contrastive Learning For Improving ASR Robustness In Spoken Language Understanding (2022)6.34
• Attentive Contextual Carryover For Multi-turn End-to-end Spoken Language Understanding (2021)7.16
• Joint On-line Learning Of A Zero-shot Spoken Semantic Parser And A Reinforcement Learning Dialogue Manager (2018)0.00