Temporal Convolution For Real-time Keyword Spotting On Mobile Devices

Abstract

Keyword spotting (KWS) plays a critical role in enabling speech-based user interactions on smart devices. Recent developments in the field of deep learning have led to wide adoption of convolutional neural networks (CNNs) in KWS systems due to their exceptional accuracy and robustness. The main challenge faced by KWS systems is the trade-off between high accuracy and low latency. Unfortunately, there has been little quantitative analysis of the actual latency of KWS models on mobile devices. This is especially concerning since conventional convolution-based KWS approaches are known to require a large number of operations to attain an adequate level of performance. In this paper, we propose a temporal convolution for real-time KWS on mobile devices. Unlike most of the 2D convolution-based KWS approaches that require a deep architecture to fully capture both low- and high-frequency domains, we exploit temporal convolutions with a compact ResNet architecture. In Google Speech Command Data

Stats

• citations122
• S2 citations—
• github stars0
• HF likes0
• heat score15.67
• arxiv keychoi2019temporal

Related papers

• A Separable Temporal Convolution Neural Network With Attention For Small-footprint Keyword Spotting (2021)0.00
• Small-footprint Keyword Spotting With Multi-scale Temporal Convolution (2020)0.00
• Separable Temporal Convolution Plus Temporally Pooled Attention For Lightweight High-performance Keyword Spotting (2021)0.00
• Small-footprint Keyword Spotting With Graph Convolutional Network (2019)10.48
• Small-footprint Keyword Spotting Using Deep Neural Network And Connectionist Temporal Classifier (2017)0.00
• Efficient Keyword Spotting Using Time Delay Neural Networks (2018)10.21
• Efficient Keyword Spotting By Capturing Long-range Interactions With Temporal Lambda Networks (2021)0.00
• Online Continual Learning In Keyword Spotting For Low-resource Devices Via Pooling High-order Temporal Statistics (2023)7.50