Unsupervised Speaker Diarization In Distributed Iot Networks Using Federated Learning

Abstract

This paper presents a computationally efficient and distributed speaker diarization framework for networked IoT-style audio devices. The work proposes a Federated Learning model which can identify the participants in a conversation without the requirement of a large audio database for training. An unsupervised online update mechanism is proposed for the Federated Learning model which depends on cosine similarity of speaker embeddings. Moreover, the proposed diarization system solves the problem of speaker change detection via. unsupervised segmentation techniques using Hotelling's t-squared Statistic and Bayesian Information Criterion. In this new approach, speaker change detection is biased around detected quasi-silences, which reduces the severity of the trade-off between the missed detection and false detection rates. Additionally, the computational overhead due to frame-by-frame identification of speakers is reduced via. unsupervised clustering of speech segments. The results demon

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keybhuyan2024unsupervised

Related papers

• A Reinforcement Learning Framework For Online Speaker Diarization (2023)0.00
• Novel Architectures For Unsupervised Information Bottleneck Based Speaker Diarization Of Meetings (2020)8.09
• Overlap-aware Low-latency Online Speaker Diarization Based On End-to-end Local Segmentation (2021)10.35
• Speaker Diarization As A Fully Online Learning Problem In Minivox (2020)0.00
• Robust Speaker Clustering Using Mixtures Of Von Mises-fisher Distributions For Naturalistic Audio Streams (2018)4.52
• Speaker Diarization With LSTM (2017)17.48
• Low-latency Online Speaker Diarization With Graph-based Label Generation (2021)8.60
• Turn-to-diarize: Online Speaker Diarization Constrained By Transformer Transducer Speaker Turn Detection (2021)12.40