Locale-agnostic Universal Domain Classification Model In Spoken Language Understanding

Abstract

In this paper, we introduce an approach for leveraging available data across multiple locales sharing the same language to 1) improve domain classification model accuracy in Spoken Language Understanding and user experience even if new locales do not have sufficient data and 2) reduce the cost of scaling the domain classifier to a large number of locales. We propose a locale-agnostic universal domain classification model based on selective multi-task learning that learns a joint representation of an utterance over locales with different sets of domains and allows locales to share knowledge selectively depending on the domains. The experimental results demonstrate the effectiveness of our approach on domain classification task in the scenario of multiple locales with imbalanced data and disparate domain sets. The proposed approach outperforms other baselines models especially when classifying locale-specific domains and also low-resourced domains.

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keylee2019locale

Related papers

• Multi-domain Spoken Language Understanding Using Domain- And Task-aware Parameterization (2020)3.58
• Multi-domain Adversarial Learning For Slot Filling In Spoken Language Understanding (2017)0.00
• Toward Domain-invariant Speech Recognition Via Large Scale Training (2018)13.39
• Neural Domain Alignment For Spoken Language Recognition Based On Optimal Transport (2023)0.00
• Label-aware Multi-level Contrastive Learning For Cross-lingual Spoken Language Understanding (2022)6.34
• Multi-domain Adaptation By Self-supervised Learning For Speaker Verification (2023)0.00
• Language-universal Adapter Learning With Knowledge Distillation For End-to-end Multilingual Speech Recognition (2023)0.95
• Gl-clef: A Global-local Contrastive Learning Framework For Cross-lingual Spoken Language Understanding (2022)10.35