Cross-lingual And Multilingual Spoken Term Detection For Low-resource Indian Languages

Abstract

Spoken Term Detection (STD) is the task of searching for words or phrases within audio, given either text or spoken input as a query. In this work, we use state-of-the-art Hindi, Tamil and Telugu ASR systems cross-lingually for lexical Spoken Term Detection in ten low-resource Indian languages. Since no publicly available dataset exists for Spoken Term Detection in these languages, we create a new dataset using a publicly available TTS dataset. We report a standard metric for STD, Mean Term Weighted Value (MTWV) and show that ASR systems built in languages that are phonetically similar to the target languages have higher accuracy, however, it is also possible to get high MTWV scores for dissimilar languages by using a relaxed phone matching algorithm. We propose a technique to bootstrap the Grapheme-to-Phoneme (g2p) mapping between all the languages under consideration using publicly available resources. Gains are obtained when we combine the output of multiple ASR systems and when we

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyshah2020cross

Related papers

• Spoken Term Detection Methods For Sparse Transcription In Very Low-resource Settings (2021)0.00
• BEST-STD: Bidirectional Mamba-enhanced Speech Tokenization For Spoken Term Detection (2024)2.26
• Spoken Term Detection And Relevance Score Estimation Using Dot-product Of Pronunciation Embeddings (2022)5.84
• A Nonparametric Bayesian Approach For Spoken Term Detection By Example Query (2016)0.00
• Weakly Supervised Spoken Term Discovery Using Cross-lingual Side Information (2016)2.26
• BEST-STD2.0: Balanced And Efficient Speech Tokenizer For Spoken Term Detection (2025)0.00
• Cross-lingual Query-by-example Spoken Term Detection: A Transformer-based Approach (2024)0.00
• Enhancing Out-of-vocabulary Performance Of Indian TTS Systems For Practical Applications Through Low-effort Data Strategies (2024)0.00