Streaming Small-footprint Keyword Spotting Using Sequence-to-sequence Models

Abstract

We develop streaming keyword spotting systems using a recurrent neural network transducer (RNN-T) model: an all-neural, end-to-end trained, sequence-to-sequence model which jointly learns acoustic and language model components. Our models are trained to predict either phonemes or graphemes as subword units, thus allowing us to detect arbitrary keyword phrases, without any out-of-vocabulary words. In order to adapt the models to the requirements of keyword spotting, we propose a novel technique which biases the RNN-T system towards a specific keyword of interest. Our systems are compared against a strong sequence-trained, connectionist temporal classification (CTC) based "keyword-filler" baseline, which is augmented with a separate phoneme language model. Overall, our RNN-T system with the proposed biasing technique significantly improves performance over the baseline system.

Stats

• citations44
• S2 citations—
• github stars0
• HF likes0
• heat score12.40
• arxiv keyhe2017streaming

Related papers

• End-to-end Streaming Keyword Spotting (2018)12.10
• Small-footprint Open-vocabulary Keyword Spotting With Quantized LSTM Networks (2020)0.00
• Small-footprint Keyword Spotting Using Deep Neural Network And Connectionist Temporal Classifier (2017)0.00
• Efficient Keyword Spotting Using Dilated Convolutions And Gating (2018)13.84
• Exploring Sequence-to-sequence Transformer-transducer Models For Keyword Spotting (2022)5.24
• Streaming Keyword Spotting Boosted By Cross-layer Discrimination Consistency (2024)6.34
• DCCRN-KWS: An Audio Bias Based Model For Noise Robust Small-footprint Keyword Spotting (2023)5.24
• Predicting Detection Filters For Small Footprint Open-vocabulary Keyword Spotting (2019)9.92