Estimation Of Speaker Age And Height From Speech Signal Using Bi-encoder Transformer Mixture Model

Abstract

The estimation of speaker characteristics such as age and height is a challenging task, having numerous applications in voice forensic analysis. In this work, we propose a bi-encoder transformer mixture model for speaker age and height estimation. Considering the wide differences in male and female voice characteristics such as differences in formant and fundamental frequencies, we propose the use of two separate transformer encoders for the extraction of specific voice features in the male and female gender, using wav2vec 2.0 as a common-level feature extractor. This architecture reduces the interference effects during backpropagation and improves the generalizability of the model. We perform our experiments on the TIMIT dataset and significantly outperform the current state-of-the-art results on age estimation. Specifically, we achieve root mean squared error (RMSE) of 5.54 years and 6.49 years for male and female age estimation, respectively. Further experiment to evaluate the relat

Stats

• citations11
• S2 citations—
• github stars0
• HF likes0
• heat score8.09
• arxiv keygupta2022estimation

Related papers

• Joint Gender And Age Estimation Based On Speech Signals Using X-vectors And Transfer Learning (2020)0.00
• Learning Speaker Representation With Semi-supervised Learning Approach For Speaker Profiling (2021)0.00
• Cross-age Speaker Verification: Learning Age-invariant Speaker Embeddings (2022)11.36
• Disentangling Age And Identity With A Mutual Information Minimization Approach For Cross-age Speaker Verification (2024)2.26
• SEGAA: A Unified Approach To Predicting Age, Gender, And Emotion In Speech (2024)0.00
• Y-vector: Multiscale Waveform Encoder For Speaker Embedding (2020)8.60
• Investigation Of Speaker-adaptation Methods In Transformer Based ASR (2020)0.00
• SVLDL: Improved Speaker Age Estimation Using Selective Variance Label Distribution Learning (2022)2.26