CNVSRC 2023: The First Chinese Continuous Visual Speech Recognition Challenge

Abstract

The first Chinese Continuous Visual Speech Recognition Challenge aimed to probe the performance of Large Vocabulary Continuous Visual Speech Recognition (LVC-VSR) on two tasks: (1) Single-speaker VSR for a particular speaker and (2) Multi-speaker VSR for a set of registered speakers. The challenge yielded highly successful results, with the best submission significantly outperforming the baseline, particularly in the single-speaker task. This paper comprehensively reviews the challenge, encompassing the data profile, task specifications, and baseline system construction. It also summarises the representative techniques employed by the submitted systems, highlighting the most effective approaches. Additional information and resources about this challenge can be accessed through the official website at http://cnceleb.org/competition.

Stats

• citations5
• S2 citations—
• github stars0
• HF likes0
• heat score5.84
• arxiv keychen2024cnvsrc

Related papers

• The Npu-aslp-liauto System Description For Visual Speech Recognition In CNVSRC 2023 (2024)0.00
• CN-CELEB: A Challenging Chinese Speaker Recognition Dataset (2019)16.39
• Voxsrc 2020: The Second Voxceleb Speaker Recognition Challenge (2020)0.00
• Voxsrc 2019: The First Voxceleb Speaker Recognition Challenge (2019)0.00
• Voice Conversion Challenge 2020: Intra-lingual Semi-parallel And Cross-lingual Voice Conversion (2020)12.74
• Robust End-to-end Deep Audiovisual Speech Recognition (2016)0.00
• Voxceleb2: Deep Speaker Recognition (2018)23.96
• Beijing ZKJ-NPU Speaker Verification System For Voxceleb Speaker Recognition Challenge 2021 (2021)0.00