External Knowledge Augmented Polyphone Disambiguation Using Large Language Model
2023 · Chen Li
Abstract
One of the key issues in Mandarin Chinese text-to-speech (TTS) systems is polyphone disambiguation when doing grapheme-to-phoneme (G2P) conversion. In this paper, we introduce a novel method to solve the problem as a generation task. Following the trending research of large language models (LLM) and prompt learning, the proposed method consists of three modules. Retrieval module incorporates external knowledge which is a multi-level semantic dictionary of Chinese polyphonic characters to format the sentence into a prompt. Generation module adopts the decoder-only Transformer architecture to induce the target text. Postprocess module corrects the generated text into a valid result if needed. Experimental results show that our method outperforms the existing methods on a public dataset called CPP. We also empirically study the impacts of different templates of the prompt, different sizes of training data, and whether to incorporate external knowledge.
Authors
(none)
Tags
Stats
Related papers
- Disambiguation Of Chinese Polyphones In An End-to-end Framework With Semantic Features Extracted By Pre-trained BERT (2025)7.16
- Breezyvoice: Adapting TTS For Taiwanese Mandarin With Enhanced Polyphone Disambiguation -- Challenges And Insights (2025)0.00
- Polyphone Disambiguation And Accent Prediction Using Pre-trained Language Models In Japanese TTS Front-end (2022)5.24
- Improving Grapheme-to-phoneme Conversion Through In-context Knowledge Retrieval With Large Language Models (2024)2.26
- Dict-tts: Learning To Pronounce With Prior Dictionary Knowledge For Text-to-speech (2022)4.27
- Paralinguistics-enhanced Large Language Modeling Of Spoken Dialogue (2023)0.00
- Memory Augmented Lookup Dictionary Based Language Modeling For Automatic Speech Recognition (2022)0.00
- Get Large Language Models Ready To Speak: A Late-fusion Approach For Speech Generation (2024)5.24