Fastspeech 2: Fast And High-quality End-to-end Text To Speech

Abstract

Non-autoregressive text to speech (TTS) models such as FastSpeech can synthesize speech significantly faster than previous autoregressive models with comparable quality. The training of FastSpeech model relies on an autoregressive teacher model for duration prediction (to provide more information as input) and knowledge distillation (to simplify the data distribution in output), which can ease the one-to-many mapping problem (i.e., multiple speech variations correspond to the same text) in TTS. However, FastSpeech has several disadvantages: 1) the teacher-student distillation pipeline is complicated and time-consuming, 2) the duration extracted from the teacher model is not accurate enough, and the target mel-spectrograms distilled from teacher model suffer from information loss due to data simplification, both of which limit the voice quality. In this paper, we propose FastSpeech 2, which addresses the issues in FastSpeech and better solves the one-to-many mapping problem in TTS by 1)

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyren2020fastspeech

Related papers

• Fastspeech: Fast, Robust And Controllable Text To Speech (2019)0.00
• JETS: Jointly Training Fastspeech2 And Hifi-gan For End To End Text To Speech (2022)12.10
• Efficienttts: An Efficient And High-quality Text-to-speech Architecture (2020)0.00
• FLY-TTS: Fast, Lightweight And High-quality End-to-end Text-to-speech Synthesis (2024)0.00
• Tts-by-tts: Tts-driven Data Augmentation For Fast And High-quality Speech Synthesis (2020)9.59
• FPETS : Fully Parallel End-to-end Text-to-speech System (2018)4.52
• Improved Child Text-to-speech Synthesis Through Fastpitch-based Transfer Learning (2023)0.00
• Daspeech: Directed Acyclic Transformer For Fast And High-quality Speech-to-speech Translation (2023)5.24