Polyphone Disambiguation And Accent Prediction Using Pre-trained Language Models In Japanese TTS Front-end

Abstract

Although end-to-end text-to-speech (TTS) models can generate natural speech, challenges still remain when it comes to estimating sentence-level phonetic and prosodic information from raw text in Japanese TTS systems. In this paper, we propose a method for polyphone disambiguation (PD) and accent prediction (AP). The proposed method incorporates explicit features extracted from morphological analysis and implicit features extracted from pre-trained language models (PLMs). We use BERT and Flair embeddings as implicit features and examine how to combine them with explicit features. Our objective evaluation results showed that the proposed method improved the accuracy by 5.7 points in PD and 6.0 points in AP. Moreover, the perceptual listening test results confirmed that a TTS system employing our proposed model as a front-end achieved a mean opinion score close to that of synthesized speech with ground-truth pronunciation and accent in terms of naturalness.

Stats

• citations4
• S2 citations—
• github stars0
• HF likes0
• heat score5.24
• arxiv keyhida2022polyphone

Related papers

• Investigation Of Japanese Png BERT Language Model In Text-to-speech Synthesis For Pitch Accent Language (2022)8.09
• External Knowledge Augmented Polyphone Disambiguation Using Large Language Model (2023)0.00
• Disambiguation Of Chinese Polyphones In An End-to-end Framework With Semantic Features Extracted By Pre-trained BERT (2025)7.16
• Dict-tts: Learning To Pronounce With Prior Dictionary Knowledge For Text-to-speech (2022)4.27
• Breezyvoice: Adapting TTS For Taiwanese Mandarin With Enhanced Polyphone Disambiguation -- Challenges And Insights (2025)0.00
• Cross-dialect Text-to-speech In Pitch-accent Language Incorporating Multi-dialect Phoneme-level BERT (2024)3.58
• Investigation Of Enhanced Tacotron Text-to-speech Synthesis Systems With Self-attention For Pitch Accent Language (2018)12.54
• Phoneme-level BERT For Enhanced Prosody Of Text-to-speech With Grapheme Predictions (2023)0.00