Conformer-based Hybrid ASR System For Switchboard Dataset

Abstract

The recently proposed conformer architecture has been successfully used for end-to-end automatic speech recognition (ASR) architectures achieving state-of-the-art performance on different datasets. To our best knowledge, the impact of using conformer acoustic model for hybrid ASR is not investigated. In this paper, we present and evaluate a competitive conformer-based hybrid model training recipe. We study different training aspects and methods to improve word-error-rate as well as to increase training speed. We apply time downsampling methods for efficient training and use transposed convolutions to upsample the output sequence again. We conduct experiments on Switchboard 300h dataset and our conformer-based hybrid model achieves competitive results compared to other architectures. It generalizes very well on Hub5'01 test set and outperforms the BLSTM-based hybrid model significantly.

Stats

• citations17
• S2 citations—
• github stars0
• HF likes0
• heat score9.41
• arxiv keyzeineldeen2021conformer

Related papers

• Efficient And Robust Long-form Speech Recognition With Hybrid H3-conformer (2024)3.58
• Advancing CTC-CRF Based End-to-end Speech Recognition With Wordpieces And Conformers (2021)0.00
• Towards A Unified Conformer Structure: From ASR To ASV Task (2022)13.11
• Single Headed Attention Based Sequence-to-sequence Model For State-of-the-art Results On Switchboard (2020)0.00
• Confidence Score Based Conformer Speaker Adaptation For Speech Recognition (2022)8.09
• Two-pass Decoding And Cross-adaptation Based System Combination Of End-to-end Conformer And Hybrid TDNN ASR Systems (2022)6.34
• Fast Conformer With Linearly Scalable Attention For Efficient Speech Recognition (2023)14.47
• Factorised Speaker-environment Adaptive Training Of Conformer Speech Recognition Systems (2023)0.00