Spatial And Spectral Deep Attention Fusion For Multi-channel Speech Separation Using Deep Embedding Features

Abstract

Multi-channel deep clustering (MDC) has acquired a good performance for speech separation. However, MDC only applies the spatial features as the additional information. So it is difficult to learn mutual relationship between spatial and spectral features. Besides, the training objective of MDC is defined at embedding vectors, rather than real separated sources, which may damage the separation performance. In this work, we propose a deep attention fusion method to dynamically control the weights of the spectral and spatial features and combine them deeply. In addition, to solve the training objective problem of MDC, the real separated sources are used as the training objectives. Specifically, we apply the deep clustering network to extract deep embedding features. Instead of using the unsupervised K-means clustering to estimate binary masks, another supervised network is utilized to learn soft masks from these deep embedding features. Our experiments are conducted on a spatialized rever

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfan2020spatial

Related papers

• Single-channel Multi-speaker Separation Using Deep Clustering (2016)0.00
• Efficient Integration Of Multi-channel Information For Speaker-independent Speech Separation (2020)0.00
• Orthonormal Embedding-based Deep Clustering For Single-channel Speech Separation (2019)0.00
• Multi-channel Speech Separation Using Spatially Selective Deep Non-linear Filters (2023)10.35
• Enhancing End-to-end Multi-channel Speech Separation Via Spatial Feature Learning (2020)12.47
• Audio-visual Speech Separation Based On Joint Feature Representation With Cross-modal Attention (2022)0.00
• Discriminative Learning For Monaural Speech Separation Using Deep Embedding Features (2019)8.60
• Improved Speech Separation With Time-and-frequency Cross-domain Joint Embedding And Clustering (2019)10.74