Inqss: A Speech Intelligibility And Quality Assessment Model Using A Multi-task Learning Network

Abstract

Speech intelligibility and quality assessment models are essential tools for researchers to evaluate and improve speech processing models. However, only a few studies have investigated multi-task models for intelligibility and quality assessment due to the limitations of available data. In this study, we released TMHINT-QI, the first Chinese speech dataset that records the quality and intelligibility scores of clean, noisy, and enhanced utterances. Then, we propose InQSS, a non-intrusive multi-task learning framework for intelligibility and quality assessment. We evaluated the InQSS on both the training-from-scratch and the pretrained models. The experimental results confirm the effectiveness of the InQSS framework. In addition, the resulting model can predict not only the intelligibility scores but also the quality scores of a speech signal.

Stats

• citations19
• S2 citations—
• github stars0
• HF likes0
• heat score9.76
• arxiv keychen2021inqss

Related papers

• Multi-task Pseudo-label Learning For Non-intrusive Speech Quality Assessment Model (2023)0.00
• Metricnet: Towards Improved Modeling For Non-intrusive Speech Quality Assessment (2021)0.00
• Stoi-net: A Deep Learning Based Non-intrusive Speech Intelligibility Assessment Model (2020)0.00
• Quality-net: An End-to-end Non-intrusive Speech Quality Assessment Model Based On BLSTM (2018)15.62
• More For Less: Non-intrusive Speech Quality Assessment With Limited Annotations (2021)7.16
• Non-intrusive Speech Quality Assessment Using Neural Networks (2019)13.74
• Ccatmos: Convolutional Context-aware Transformer Network For Non-intrusive Speech Quality Assessment (2022)5.24
• Torchaudio-squim: Reference-less Speech Quality And Intelligibility Measures In Torchaudio (2023)0.00