Dynamic Time-aware Attention To Speaker Roles And Contexts For Spoken Language Understanding

Abstract

Spoken language understanding (SLU) is an essential component in conversational systems. Most SLU component treats each utterance independently, and then the following components aggregate the multi-turn information in the separate phases. In order to avoid error propagation and effectively utilize contexts, prior work leveraged history for contextual SLU. However, the previous model only paid attention to the content in history utterances without considering their temporal information and speaker roles. In the dialogues, the most recent utterances should be more important than the least recent ones. Furthermore, users usually pay attention to 1) self history for reasoning and 2) others' utterances for listening, the speaker of the utterances may provides informative cues to help understanding. Therefore, this paper proposes an attention-based network that additionally leverages temporal information and speaker role for better SLU, where the attention to contexts and speaker roles can

Stats

• citations12
• S2 citations—
• github stars0
• HF likes0
• heat score8.35
• arxiv keychen2017dynamic

Related papers

• Dynamically Context-sensitive Time-decay Attention For Dialogue Modeling (2018)2.26
• Attentive Contextual Carryover For Multi-turn End-to-end Spoken Language Understanding (2021)7.16
• Decay-function-free Time-aware Attention To Context And Speaker Indicator For Spoken Language Understanding (2019)0.00
• Modeling Inter-speaker Relationship In Xlnet For Contextual Spoken Language Understanding (2019)0.00
• Improving End-to-end SLU Performance With Prosodic Attention And Distillation (2023)0.00
• Recent Advances In End-to-end Spoken Language Understanding (2019)8.09
• Building Robust Spoken Language Understanding By Cross Attention Between Phoneme Sequence And ASR Hypothesis (2022)2.26
• Attention-based Contextual Language Model Adaptation For Speech Recognition (2021)0.00