PCNN: A Lightweight Parallel Conformer Neural Network For Efficient Monaural Speech Enhancement
2023 · Xinmeng Xu, Weiping Tu, Yuhong Yang
Abstract
Convolutional neural networks (CNN) and Transformer have wildly succeeded in multimedia applications. However, more effort needs to be made to harmonize these two architectures effectively to satisfy speech enhancement. This paper aims to unify these two architectures and presents a Parallel Conformer for speech enhancement. In particular, the CNN and the self-attention (SA) in the Transformer are fully exploited for local format patterns and global structure representations. Based on the small receptive field size of CNN and the high computational complexity of SA, we specially designed a multi-branch dilated convolution (MBDC) and a self-channel-time-frequency attention (Self-CTFA) module. MBDC contains three convolutional layers with different dilation rates for the feature from local to non-local processing. Experimental results show that our method performs better than state-of-the-art methods in most evaluation criteria while maintaining the lowest model parameters.
Authors
(none)
Tags
Stats
Related papers
- Monaural Speech Enhancement Using A Multi-branch Temporal Convolutional Network (2019)3.58
- Fast Conformer With Linearly Scalable Attention For Efficient Speech Recognition (2023)14.47
- TFCN: Temporal-frequential Convolutional Network For Single-channel Speech Enhancement (2022)0.00
- Df-conformer: Integrated Architecture Of Conv-tasnet And Conformer Using Linear Complexity Self-attention For Speech Enhancement (2021)11.29
- Multi-modal Hybrid Deep Neural Network For Speech Enhancement (2016)0.00
- Efficient Encoder-decoder And Dual-path Conformer For Comprehensive Feature Learning In Speech Enhancement (2023)7.16
- DEFORMER: Coupling Deformed Localized Patterns With Global Context For Robust End-to-end Speech Recognition (2022)0.00
- An Efficient Speech Separation Network Based On Recurrent Fusion Dilated Convolution And Channel Attention (2023)0.00