A Cascaded Multiple-speaker Localization And Tracking System

Abstract

This paper presents an online multiple-speaker localization and tracking method, as the INRIA-Perception contribution to the LOCATA Challenge 2018. First, the recursive least-square method is used to adaptively estimate the direct-path relative transfer function as an interchannel localization feature. The feature is assumed to associate with a single speaker at each time-frequency bin. Second, a complex Gaussian mixture model (CGMM) is used as a generative model of the features. The weight of each CGMM component represents the probability that this component corresponds to an active speaker, and is adaptively estimated with an online optimization algorithm. Finally, taking the CGMM component weights as observations, a Bayesian multiple-speaker tracking method based on the variational expectation maximization algorithm is used. The tracker accounts for the variation of active speakers and the localization miss measurements, by introducing speaker birth and sleeping processes. The exper

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyli2018a

Related papers

• Multiple-speaker Localization Based On Direct-path Features And Likelihood Maximization With Spatial Sparsity Regularization (2016)11.85
• The Importance Of Spatial And Spectral Information In Multiple Speaker Tracking (2024)0.00
• Jointly Tracking And Separating Speech Sources Using Multiple Features And The Generalized Labeled Multi-bernoulli Framework (2017)0.00
• Multi-speaker Localization Using Convolutional Neural Network Trained With Noise (2017)0.00
• Deep Learning Based Stage-wise Two-dimensional Speaker Localization With Large Ad-hoc Microphone Arrays (2022)3.58
• Analyzing The Impact Of Speaker Localization Errors On Speech Separation For Automatic Speech Recognition (2019)0.00
• Deep Learning Based Multi-source Localization With Source Splitting And Its Effectiveness In Multi-talker Speech Recognition (2021)14.23
• Saladnet: Self-attentive Multisource Localization In The Ambisonics Domain (2021)7.50