Cross-lingual Query-by-example Spoken Term Detection: A Transformer-based Approach

Abstract

Query-by-example spoken term detection (QbE-STD) is typically constrained by transcribed data scarcity and language specificity. This paper introduces a novel, language-agnostic QbE-STD model leveraging image processing techniques and transformer architecture. By employing a pre-trained XLSR-53 network for feature extraction and a Hough transform for detection, our model effectively searches for user-defined spoken terms within any audio file. Experimental results across four languages demonstrate significant performance gains (19-54%) over a CNN-based baseline. While processing time is improved compared to DTW, accuracy remains inferior. Notably, our model offers the advantage of accurately counting query term repetitions within the target audio.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfatemeh2024cross

Related papers

• Neural Network Based End-to-end Query By Example Spoken Term Detection (2019)0.00
• Multilingual Bottleneck Features For Query By Example Spoken Term Detection (2019)9.23
• Query-by-example Spoken Term Detection Using Attention-based Multi-hop Networks (2017)9.23
• A Nonparametric Bayesian Approach For Spoken Term Detection By Example Query (2016)0.00
• BEST-STD2.0: Balanced And Efficient Speech Tokenizer For Spoken Term Detection (2025)0.00
• Semantic Query-by-example Speech Search Using Visual Grounding (2019)7.81
• BEST-STD: Bidirectional Mamba-enhanced Speech Tokenization For Spoken Term Detection (2024)2.26
• Spoken Term Detection And Relevance Score Estimation Using Dot-product Of Pronunciation Embeddings (2022)5.84