Mixtures Of Deep Neural Experts For Automated Speech Scoring

Abstract

The paper copes with the task of automatic assessment of second language proficiency from the language learners' spoken responses to test prompts. The task has significant relevance to the field of computer assisted language learning. The approach presented in the paper relies on two separate modules: (1) an automatic speech recognition system that yields text transcripts of the spoken interactions involved, and (2) a multiple classifier system based on deep learners that ranks the transcripts into proficiency classes. Different deep neural network architectures (both feed-forward and recurrent) are specialized over diverse representations of the texts in terms of: a reference grammar, the outcome of probabilistic language models, several word embeddings, and two bag-of-word models. Combination of the individual classifiers is realized either via a probabilistic pseudo-joint model, or via a neural mixture of experts. Using the data of the third Spoken CALL Shared Task challenge, the hi

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keypapi2021mixtures

Related papers

• Multi-modal Automated Speech Scoring Using Attention Fusion (2020)0.00
• Speechcolab Leaderboard: An Open-source Platform For Automatic Speech Recognition Evaluation (2024)9.05
• Autospeech 2020: The Second Automated Machine Learning Challenge For Speech Classification (2020)3.58
• Mole : Mixture Of Language Experts For Multi-lingual Automatic Speech Recognition (2023)9.41
• Neural Scoring: A Refreshed End-to-end Approach For Speaker Recognition In Complex Conditions (2024)0.00
• Preference-based Training Framework For Automatic Speech Quality Assessment Using Deep Neural Network (2023)5.24
• Enhancing Neural Spoken Language Recognition: An Exploration With Multilingual Datasets (2025)0.00
• Superm2m: Supervised And Mixture-to-mixture Co-learning For Speech Enhancement And Noise-robust ASR (2024)5.24