Assessing The Robustness Of Spectral Clustering For Deep Speaker Diarization

Abstract

Clustering speaker embeddings is crucial in speaker diarization but hasn't received as much focus as other components. Moreover, the robustness of speaker diarization across various datasets hasn't been explored when the development and evaluation data are from different domains. To bridge this gap, this study thoroughly examines spectral clustering for both same-domain and cross-domain speaker diarization. Our extensive experiments on two widely used corpora, AMI and DIHARD, reveal the performance trend of speaker diarization in the presence of domain mismatch. We observe that the performance difference between two different domain conditions can be attributed to the role of spectral clustering. In particular, keeping other modules unchanged, we show that differences in optimal tuning parameters as well as speaker count estimation originates due to the mismatch. This study opens several future directions for speaker diarization research.

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keyraghav2024assessing

Related papers

• Enhancements For Audio-only Diarization Systems (2019)0.00
• Robust Acoustic Domain Identification With Its Application To Speaker Diarization (2022)2.26
• Multi-class Spectral Clustering With Overlaps For Speaker Diarization (2020)10.35
• Reformulating Speaker Diarization As Community Detection With Emphasis On Topological Structure (2022)5.84
• Highly Efficient Real-time Streaming And Fully On-device Speaker Diarization With Multi-stage Clustering (2022)0.00
• Self-tuning Spectral Clustering For Speaker Diarization (2024)3.81
• Spectral Clustering-aware Learning Of Embeddings For Speaker Diarisation (2022)2.26
• Deep Self-supervised Hierarchical Clustering For Speaker Diarization (2020)5.24