Transmask: A Compact And Fast Speech Separation Model Based On Transformer

Abstract

Speech separation is an important problem in speech processing, which targets to separate and generate clean speech from a mixed audio containing speech from different speakers. Empowered by the deep learning technologies over sequence-to-sequence domain, recent neural speech separation models are now capable of generating highly clean speech audios. To make these models more practical by reducing the model size and inference time while maintaining high separation quality, we propose a new transformer-based speech separation approach, called TransMask. By fully un-leashing the power of self-attention on long-term dependency exception, we demonstrate the size of TransMask is more than 60% smaller and the inference is more than 2 times faster than state-of-the-art solutions. TransMask fully utilizes the parallelism during inference, and achieves nearly linear inference time within reasonable input audio lengths. It also outperforms existing solutions on output speech audio quality, achie

Stats

• citations14
• S2 citations—
• github stars0
• HF likes0
• heat score8.82
• arxiv keyzhang2021transmask

Related papers

• Tiny-sepformer: A Tiny Time-domain Transformer Network For Speech Separation (2022)8.82
• Exploring Self-attention Mechanisms For Speech Separation (2022)12.54
• Monaural Multi-speaker Speech Separation Using Efficient Transformer Model (2023)0.00
• Attention Is All You Need In Speech Separation (2020)20.59
• Resource-efficient Separation Transformer (2022)7.81
• Conv-tasnet: Surpassing Ideal Time-frequency Magnitude Masking For Speech Separation (2018)24.08
• Effective Decoder Masking For Transformer Based End-to-end Speech Recognition (2020)0.00
• Dual-path Transformer Network: Direct Context-aware Modeling For End-to-end Monaural Speech Separation (2020)18.24