Cm-net: A Novel Collaborative Memory Network For Spoken Language Understanding

Abstract

Spoken Language Understanding (SLU) mainly involves two tasks, intent detection and slot filling, which are generally modeled jointly in existing works. However, most existing models fail to fully utilize co-occurrence relations between slots and intents, which restricts their potential performance. To address this issue, in this paper we propose a novel Collaborative Memory Network (CM-Net) based on the well-designed block, named CM-block. The CM-block firstly captures slot-specific and intent-specific features from memories in a collaborative manner, and then uses these enriched features to enhance local context representations, based on which the sequential information flow leads to more specific (slot and intent) global utterance representations. Through stacking multiple CM-blocks, our CM-Net is able to alternately perform information exchange among specific memories, local contexts and the global utterance, and thus incrementally enriches each other. We evaluate the CM-Net on two

Stats

• citations58
• S2 citations—
• github stars0
• HF likes0
• heat score13.28
• arxiv keyliu2019cm

Related papers

• A Novel Bi-directional Interrelated Model For Joint Intent Detection And Slot Filling (2019)12.33
• Joint Online Spoken Language Understanding And Language Modeling With Recurrent Neural Networks (2016)13.28
• Recent Advances In End-to-end Spoken Language Understanding (2019)8.09
• Unislu: Unified Spoken Language Understanding From Heterogeneous Cross-task Datasets (2025)0.00
• Modeling Inter-speaker Relationship In Xlnet For Contextual Spoken Language Understanding (2019)0.00
• PIN: A Novel Parallel Interactive Network For Spoken Language Understanding (2020)8.09
• Towards ASR Robust Spoken Language Understanding Through In-context Learning With Word Confusion Networks (2024)0.00
• ML-LMCL: Mutual Learning And Large-margin Contrastive Learning For Improving ASR Robustness In Spoken Language Understanding (2023)0.00