All-neural Online Source Separation, Counting, And Diarization For Meeting Analysis
2019 · Thilo von Neumann, Keisuke Kinoshita, Marc Delcroix, et al.
Abstract
Automatic meeting analysis comprises the tasks of speaker counting, speaker diarization, and the separation of overlapped speech, followed by automatic speech recognition. This all has to be carried out on arbitrarily long sessions and, ideally, in an online or block-online manner. While significant progress has been made on individual tasks, this paper presents for the first time an all-neural approach to simultaneous speaker counting, diarization and source separation. The NN-based estimator operates in a block-online fashion and tracks speakers even if they remain silent for a number of time blocks, thus learning a stable output order for the separated sources. The neural network is recurrent over time as well as over the number of sources. The simulation experiments show that state of the art separation performance is achieved, while at the same time delivering good diarization and source counting results. It even generalizes well to an unseen large number of blocks.
Authors
(none)
Tags
Stats
Related papers
- Neural Blind Source Separation And Diarization For Distant Speech Recognition (2024)0.00
- Integration Of Speech Separation, Diarization, And Recognition For Multi-speaker Meetings: System Description, Comparison, And Analysis (2020)13.23
- Simultaneous Diarization And Separation Of Meetings Through The Integration Of Statistical Mixture Models (2024)0.00
- EEND-SS: Joint End-to-end Neural Speaker Diarization And Speech Separation For Flexible Number Of Speakers (2022)10.35
- TS-SEP: Joint Diarization And Separation Conditioned On Estimated Speaker Embeddings (2023)10.35
- Independence-based Joint Dereverberation And Separation With Neural Source Model (2021)4.52
- Simultaneous Speech Extraction For Multiple Target Speakers Under The Meeting Scenarios (2022)2.26
- Spatially-augmented Sequence-to-sequence Neural Diarization For Meetings (2025)0.00