Large Language Model Based Generative Error Correction: A Challenge And Baselines For Speech Recognition, Speaker Tagging, And Emotion Recognition

Abstract

Given recent advances in generative AI technology, a key question is how large language models (LLMs) can enhance acoustic modeling tasks using text decoding results from a frozen, pretrained automatic speech recognition (ASR) model. To explore new capabilities in language modeling for speech processing, we introduce the generative speech transcription error correction (GenSEC) challenge. This challenge comprises three post-ASR language modeling tasks: (i) post-ASR transcription correction, (ii) speaker tagging, and (iii) emotion recognition. These tasks aim to emulate future LLM-based agents handling voice-based interfaces while remaining accessible to a broad audience by utilizing open pretrained language models or agent-based APIs. We also discuss insights from baseline evaluations, as well as lessons learned for designing future evaluations.

Stats

• citations10
• S2 citations—
• github stars0
• HF likes0
• heat score7.81
• arxiv keyyang2024large

Related papers

• Multi-stage Large Language Model Correction For Speech Recognition (2023)0.00
• ASR Error Correction Using Large Language Models (2024)9.41
• Context And System Fusion In Post-asr Emotion Recognition With Large Language Models (2024)0.00
• Exploring The Integration Of Large Language Models Into Automatic Speech Recognition Systems: An Empirical Study (2023)8.09
• Revise, Reason, And Recognize: Llm-based Emotion Recognition Via Emotion-specific Prompts And ASR Error Correction (2024)7.81
• Generative Error Correction For Code-switching Speech Recognition Using Large Language Models (2023)0.00
• Chain Of Correction For Full-text Speech Recognition With Large Language Models (2025)0.00
• Towards Interfacing Large Language Models With ASR Systems Using Confidence Measures And Prompting (2024)7.16