Deep Learning For Audio Transcription On Low-resource Datasets

Abstract

In training a deep learning system to perform audio transcription, two practical problems may arise. Firstly, most datasets are weakly labelled, having only a list of events present in each recording without any temporal information for training. Secondly, deep neural networks need a very large amount of labelled training data to achieve good quality performance, yet in practice it is difficult to collect enough samples for most classes of interest. In this paper, we propose factorising the final task of audio transcription into multiple intermediate tasks in order to improve the training performance when dealing with this kind of low-resource datasets. We evaluate three data-efficient approaches of training a stacked convolutional and recurrent neural network for the intermediate tasks. Our results show that different methods of training have different advantages and disadvantages.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keymorfi2018deep

Related papers

• Deepfake Audio As A Data Augmentation Technique For Training Automatic Speech To Text Transcription Models (2023)2.26
• Leveraging Translations For Speech Transcription In Low-resource Settings (2018)6.77
• Multi-task Regularization Based On Infrequent Classes For Audio Captioning (2020)0.00
• Spoken Term Detection Methods For Sparse Transcription In Very Low-resource Settings (2021)0.00
• Variational Information Bottleneck For Effective Low-resource Audio Classification (2021)7.81
• Temporal Sub-sampling Of Audio Feature Sequences For Automated Audio Captioning (2020)0.00
• Reducing Model Complexity For DNN Based Large-scale Audio Classification (2017)9.59
• Towards Efficient And Real-time Piano Transcription Using Neural Autoregressive Models (2024)5.84