Independent And Automatic Evaluation Of Acoustic-to-articulatory Inversion Models

Abstract

Reconstruction of articulatory trajectories from the acoustic speech signal has been proposed for improving speech recognition and text-to-speech synthesis. However, to be useful in these settings, articulatory reconstruction must be speaker independent. Furthermore, as most research focuses on single, small datasets with few speakers, robust articulatory reconstrucion could profit from combining datasets. Standard evaluation measures such as root mean square error and Pearson correlation are inappropriate for evaluating the speaker-independence of models or the usefulness of combining datasets. We present a new evaluation for articulatory reconstruction which is independent of the articulatory data set used for training: the phone discrimination ABX task. We use the ABX measure to evaluate a Bi-LSTM based model trained on 3 datasets (14 speakers), and show that it gives information complementary to the standard measures, and enables us to evaluate the effects of dataset merging, as we

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyparrot2019independent

Related papers

• Speaker-independent Acoustic-to-articulatory Inversion Through Multi-channel Attention Discriminator (2024)0.00
• Acoustic-to-articulatory Inversion Based On Speech Decomposition And Auxiliary Feature (2022)0.00
• Speaker- And Text-independent Estimation Of Articulatory Movements And Phoneme Alignments From Speech (2024)2.26
• Exploiting Cross Domain Acoustic-to-articulatory Inverted Features For Disordered Speech Recognition (2022)8.09
• ARTI-6: Towards Six-dimensional Articulatory Speech Encoding (2025)0.00
• Articulatory-wavenet: Autoregressive Model For Acoustic-to-articulatory Inversion (2020)0.00
• Establishing Degrees Of Closeness Between Audio Recordings Along Different Dimensions Using Large-scale Cross-lingual Models (2024)0.00
• Audio Data Augmentation For Acoustic-to-articulatory Speech Inversion Using Bidirectional Gated Rnns (2022)0.00