Learning From Multiple Noisy Augmented Data Sets For Better Cross-lingual Spoken Language Understanding

Abstract

Lack of training data presents a grand challenge to scaling out spoken language understanding (SLU) to low-resource languages. Although various data augmentation approaches have been proposed to synthesize training data in low-resource target languages, the augmented data sets are often noisy, and thus impede the performance of SLU models. In this paper we focus on mitigating noise in augmented data. We develop a denoising training approach. Multiple models are trained with data produced by various augmented methods. Those models provide supervision signals to each other. The experimental results show that our method outperforms the existing state of the art by 3.05 and 4.24 percentage points on two benchmark datasets, respectively. The code will be made open sourced on github.

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keyguo2021learning

Related papers

• Data Augmentation For Spoken Language Understanding Via Pretrained Language Models (2020)0.00
• Data Augmentation For Spoken Language Understanding Via Joint Variational Generation (2018)10.61
• Bridging The Gap Between Clean Data Training And Real-world Inference For Spoken Language Understanding (2021)0.00
• Reduce, Reuse, Recycle: Is Perturbed Data Better Than Other Language Augmentation For Low Resource Self-supervised Speech Models (2023)0.00
• ASR Data Augmentation In Low-resource Settings Using Cross-lingual Multi-speaker TTS And Cross-lingual Voice Conversion (2022)6.77
• Using Speech Synthesis To Train End-to-end Spoken Language Understanding Models (2019)9.23
• Improving Sequence-to-sequence Speech Recognition Training With On-the-fly Data Augmentation (2019)0.00
• A Study On The Integration Of Pre-trained SSL, ASR, LM And SLU Models For Spoken Language Understanding (2022)8.09