Transfer Learning For Robust Low-resource Children's Speech ASR With Transformers And Source-filter Warping
2022 · Jenthe Thienpondt, Kris Demuynck
Abstract
Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting domain mismatch when decoding children's speech with systems trained on adult data. In this paper, we propose multiple enhancements to alleviate these issues. First, we propose a data augmentation technique based on the source-filter model of speech to close the domain gap between adult and children's speech. This enables us to leverage the data availability of adult speech corpora by making these samples perceptually similar to children's speech. Second, using this augmentation strategy, we apply transfer learning on a Transformer model pre-trained on adult data. This model follows the recently introduced XLS-R architecture, a wav2vec 2.0 model pre-trained on several cross-lingual adult speech corpora to learn general and robust acoustic frame-level
Authors
(none)
Tags
Stats
Related papers
- Improving Child Speech Recognition With Augmented Child-like Speech (2024)5.24
- Spectral Modification Based Data Augmentation For Improving End-to-end ASR For Children's Speech (2022)8.35
- A Comparative Analysis Between Conformer-transducer, Whisper, And Wav2vec2 For Improving The Child Speech Recognition (2023)7.16
- ASR Data Augmentation In Low-resource Settings Using Cross-lingual Multi-speaker TTS And Cross-lingual Voice Conversion (2022)6.77
- An Investigation On Applying Acoustic Feature Conversion To ASR Of Adult And Child Speech (2022)0.00
- Whisper Turns Stronger: Augmenting Wav2vec 2.0 For Superior ASR In Low-resource Languages (2024)0.00
- Transformer-transducers For Code-switched Speech Recognition (2020)10.97
- Frustratingly Easy Data Augmentation For Low-resource ASR (2025)0.00