Reformulating Speaker Diarization As Community Detection With Emphasis On Topological Structure

Abstract

Clustering-based speaker diarization has stood firm as one of the major approaches in reality, despite recent development in end-to-end diarization. However, clustering methods have not been explored extensively for speaker diarization. Commonly-used methods such as k-means, spectral clustering, and agglomerative hierarchical clustering only take into account properties such as proximity and relative densities. In this paper we propose to view clustering-based diarization as a community detection problem. By doing so the topological structure is considered. This work has four major contributions. First it is shown that Leiden community detection algorithm significantly outperforms the previous methods on the clustering of speaker-segments. Second, we propose to use uniform manifold approximation to reduce dimension while retaining global and local topological structure. Third, a masked filtering approach is introduced to extract "clean" speaker embeddings. Finally, the community struct

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keyzheng2022reformulating

Related papers

• End-to-end Speaker Diarization As Post-processing (2020)11.08
• Enhancements For Audio-only Diarization Systems (2019)0.00
• Assessing The Robustness Of Spectral Clustering For Deep Speaker Diarization (2024)3.58
• Advances In Integration Of End-to-end Neural And Clustering-based Diarization For Real Conversational Speech (2021)16.48
• Interrelate Training And Searching: A Unified Online Clustering Framework For Speaker Diarization (2022)6.77
• Deep Self-supervised Hierarchical Clustering For Speaker Diarization (2020)5.24
• Multi-class Spectral Clustering With Overlaps For Speaker Diarization (2020)10.35
• Highly Efficient Real-time Streaming And Fully On-device Speaker Diarization With Multi-stage Clustering (2022)0.00