Crowdspeech And Voxdiy: Benchmark Datasets For Crowdsourced Audio Transcription

Abstract

Domain-specific data is the crux of the successful transfer of machine learning systems from benchmarks to real life. In simple problems such as image classification, crowdsourcing has become one of the standard tools for cheap and time-efficient data collection: thanks in large part to advances in research on aggregation methods. However, the applicability of crowdsourcing to more complex tasks (e.g., speech recognition) remains limited due to the lack of principled aggregation methods for these modalities. The main obstacle towards designing aggregation methods for more advanced applications is the absence of training data, and in this work, we focus on bridging this gap in speech recognition. For this, we collect and release CrowdSpeech -- the first publicly available large-scale dataset of crowdsourced audio transcriptions. Evaluation of existing and novel aggregation methods on our data shows room for improvement, suggesting that our work may entail the design of better algorithms

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keypavlichenko2021crowdspeech

Related papers

• Crowdsourcing A Dataset Of Audio Captions (2019)8.60
• Voxceleb: A Large-scale Speaker Identification Dataset (2017)23.55
• Voxlingua107: A Dataset For Spoken Language Recognition (2020)14.15
• Google Crowdsourced Speech Corpora And Related Open-source Resources For Low-resource Languages And Dialects: An Overview (2020)0.00
• Libri2vox Dataset: Target Speaker Extraction With Diverse Speaker Conditions And Synthetic Data (2024)0.00
• The People's Speech: A Large-scale Diverse English Speech Recognition Dataset For Commercial Usage (2021)0.00
• Voxceleb2: Deep Speaker Recognition (2018)23.96
• Voxblink2: A 100K+ Speaker Recognition Corpus And The Open-set Speaker-identification Benchmark (2024)9.41