Uformer: A Unet Based Dilated Complex & Real Dual-path Conformer Network For Simultaneous Speech Enhancement And Dereverberation
2021 · Yihui Fu, Yun Liu, Jingdong Li, et al.
Abstract
Complex spectrum and magnitude are considered as two major features of speech enhancement and dereverberation. Traditional approaches always treat these two features separately, ignoring their underlying relationship. In this paper, we propose Uformer, a Unet based dilated complex & real dual-path conformer network in both complex and magnitude domain for simultaneous speech enhancement and dereverberation. We exploit time attention (TA) and dilated convolution (DC) to leverage local and global contextual information and frequency attention (FA) to model dimensional information. These three sub-modules contained in the proposed dilated complex & real dual-path conformer module effectively improve the speech enhancement and dereverberation performance. Furthermore, hybrid encoder and decoder are adopted to simultaneously model the complex spectrum and magnitude and promote the information interaction between two domains. Encoder decoder attention is also applied to enhance the interacti
Authors
(none)
Tags
Stats
Related papers
- D2former: A Fully Complex Dual-path Dual-decoder Conformer Network Using Joint Complex Masking And Complex Spectral Mapping For Monaural Speech Enhancement (2023)0.00
- Efficient Encoder-decoder And Dual-path Conformer For Comprehensive Feature Learning In Speech Enhancement (2023)7.16
- Df-conformer: Integrated Architecture Of Conv-tasnet And Conformer Using Linear Complexity Self-attention For Speech Enhancement (2021)11.29
- U-former: Improving Monaural Speech Enhancement With Multi-head Self And Cross Attention (2022)0.00
- Single-channel Speech Enhancement With Deep Complex U-networks And Probabilistic Latent Space Models (2023)5.24
- Dbt-net: Dual-branch Federative Magnitude And Phase Estimation With Attention-in-attention Transformer For Monaural Speech Enhancement (2022)12.47
- Forknet: Simultaneous Time And Time-frequency Domain Modeling For Speech Enhancement (2023)0.00
- Phase-aware Speech Enhancement With Deep Complex U-net (2019)0.00