RETRONLU: Retrieval Augmented Task-oriented Semantic Parsing

Abstract

While large pre-trained language models accumulate a lot of knowledge in their parameters, it has been demonstrated that augmenting it with non-parametric retrieval-based memory has a number of benefits from accuracy improvements to data efficiency for knowledge-focused tasks, such as question answering. In this paper, we are applying retrieval-based modeling ideas to the problem of multi-domain task-oriented semantic parsing for conversational assistants. Our approach, RetroNLU, extends a sequence-to-sequence model architecture with a retrieval component, used to fetch existing similar examples and provide them as an additional input to the model. In particular, we analyze two settings, where we augment an input with (a) retrieved nearest neighbor utterances (utterance-nn), and (b) ground-truth semantic parses of nearest neighbor utterances (semparse-nn). Our technique outperforms the baseline method by 1.5% absolute macro-F1, especially at the low resource setting, matching the basel

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keygupta2021retronlu

Related papers

• Retro-li: Small-scale Retrieval Augmented Generation Supporting Noisy Similarity Searches And Domain Shift Generalization (2024)4.06
• Retrieval Augmentation For Deep Neural Networks (2021)5.84
• Rare: Retrieval Augmented Retrieval With In-context Examples (2024)0.00
• Uniretriever: Multi-task Candidates Selection For Various Context-adaptive Conversational Retrieval (2024)0.00
• Optimizing Retrieval-augmented Generation: Analysis Of Hyperparameter Impact On Performance And Efficiency (2025)0.00
• Modular Retrieval For Generalization And Interpretation (2023)0.00
• Freeret: Mllms As Training-free Retrievers (2025)0.00
• Murag: Multimodal Retrieval-augmented Generator For Open Question Answering Over Images And Text (2022)14.66