Mitigating The Impact Of Speech Recognition Errors On Chatbot Using Sequence-to-sequence Model

Abstract

We apply sequence-to-sequence model to mitigate the impact of speech recognition errors on open domain end-to-end dialog generation. We cast the task as a domain adaptation problem where ASR transcriptions and original text are in two different domains. In this paper, our proposed model includes two individual encoders for each domain data and make their hidden states similar to ensure the decoder predict the same dialog text. The method shows that the sequence-to-sequence model can learn the ASR transcriptions and original text pair having the same meaning and eliminate the speech recognition errors. Experimental results on Cornell movie dialog dataset demonstrate that the domain adaption system help the spoken dialog system generate more similar responses with the original text answers.

Stats

• citations10
• S2 citations—
• github stars0
• HF likes0
• heat score7.81
• arxiv keychen2017mitigating

Related papers

• Towards Better Decoding And Language Model Integration In Sequence To Sequence Models (2016)15.67
• Mitigating The Impact Of Speech Recognition Errors On Spoken Question Answering By Adversarial Domain Adaptation (2019)6.77
• Exploring Textual And Speech Information In Dialogue Act Classification With Speaker Domain Adaptation (2018)0.00
• Exploring Machine Speech Chain For Domain Adaptation And Few-shot Speaker Adaptation (2021)0.00
• Unsupervised Domain Adaptation For Speech Recognition With Unsupervised Error Correction (2022)5.24
• End-to-end Multimodal Speech Recognition (2018)10.21
• Channel-aware Domain-adaptive Generative Adversarial Network For Robust Speech Recognition (2024)4.52
• Text-only Domain Adaptation For End-to-end Speech Recognition Through Down-sampling Acoustic Representation (2023)0.00