End-to-end Asr-free Keyword Search From Speech

Abstract

End-to-end (E2E) systems have achieved competitive results compared to conventional hybrid hidden Markov model (HMM)-deep neural network based automatic speech recognition (ASR) systems. Such E2E systems are attractive due to the lack of dependence on alignments between input acoustic and output grapheme or HMM state sequence during training. This paper explores the design of an ASR-free end-to-end system for text query-based keyword search (KWS) from speech trained with minimal supervision. Our E2E KWS system consists of three sub-systems. The first sub-system is a recurrent neural network (RNN)-based acoustic auto-encoder trained to reconstruct the audio through a finite-dimensional representation. The second sub-system is a character-level RNN language model using embeddings learned from a convolutional neural network. Since the acoustic and text query embeddings occupy different representation spaces, they are input to a third feed-forward neural network that predicts whether the q

Stats

• citations60
• S2 citations—
• github stars0
• HF likes0
• heat score13.39
• arxiv keyaudhkhasi2017end

Related papers

• End-to-end Keyword Spotting Using Neural Architecture Search And Quantization (2021)8.60
• Exploring Sequence-to-sequence Transformer-transducer Models For Keyword Spotting (2022)5.24
• GE2E-KWS: Generalized End-to-end Training And Evaluation For Zero-shot Keyword Spotting (2024)2.26
• Unified End-to-end Speech Recognition And Endpointing For Fast And Efficient Speech Systems (2022)5.24
• Autokws: Keyword Spotting With Differentiable Architecture Search (2020)9.92
• Streaming Small-footprint Keyword Spotting Using Sequence-to-sequence Models (2017)12.40
• Query-by-example Keyword Spotting Using Spectral-temporal Graph Attentive Pooling And Multi-task Learning (2024)0.00
• Small-footprint Open-vocabulary Keyword Spotting With Quantized LSTM Networks (2020)0.00