Improving Diarization Robustness Using Diversification, Randomization And The DOVER Algorithm

Abstract

Speaker diarization based on bottom-up clustering of speech segments by acoustic similarity is often highly sensitive to the choice of hyperparameters, such as the initial number of clusters and feature weighting. Optimizing these hyperparameters is difficult and often not robust across different data sets. We recently proposed the DOVER algorithm for combining multiple diarization hypotheses by voting. Here we propose to mitigate the robustness problem in diarization by using DOVER to average across different parameter choices. We also investigate the combination of diverse outputs obtained by following different merge choices pseudo-randomly in the course of clustering, thereby mitigating the greediness of best-first clustering. We show on two conference meeting data sets drawn from NIST evaluations that the proposed methods indeed yield more robust, and in several cases overall improved, results.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keystolcke2019improving

Related papers

• DOVER: A Method For Combining Diarization Outputs (2019)8.60
• Dover-lap: A Method For Combining Overlap-aware Diarization Outputs (2020)11.76
• Enhancements For Audio-only Diarization Systems (2019)0.00
• Assessing The Robustness Of Spectral Clustering For Deep Speaker Diarization (2024)3.58
• End-to-end Speaker Diarization As Post-processing (2020)11.08
• Advances In Integration Of End-to-end Neural And Clustering-based Diarization For Real Conversational Speech (2021)16.48
• Highly Efficient Real-time Streaming And Fully On-device Speaker Diarization With Multi-stage Clustering (2022)0.00
• Reformulating Speaker Diarization As Community Detection With Emphasis On Topological Structure (2022)5.84