Espnet-tts: Unified, Reproducible, And Integratable Open Source End-to-end Text-to-speech Toolkit

Abstract

This paper introduces a new end-to-end text-to-speech (E2E-TTS) toolkit named ESPnet-TTS, which is an extension of the open-source speech processing toolkit ESPnet. The toolkit supports state-of-the-art E2E-TTS models, including Tacotron~2, Transformer TTS, and FastSpeech, and also provides recipes inspired by the Kaldi automatic speech recognition (ASR) toolkit. The recipes are based on the design unified with the ESPnet ASR recipe, providing high reproducibility. The toolkit also provides pre-trained models and samples of all of the recipes so that users can use it as a baseline. Furthermore, the unified design enables the integration of ASR functions with TTS, e.g., ASR-based objective evaluation and semi-supervised learning with both ASR and TTS models. This paper describes the design of the toolkit and experimental evaluation in comparison with other toolkits. The experimental results show that our models can achieve state-of-the-art performance comparable to the other latest tool

Stats

• citations110
• S2 citations—
• github stars9824
• HF likes0
• heat score23.32
• arxiv keyhayashi2019espnet

Related papers

• Espnet: End-to-end Speech Processing Toolkit (2018)22.17
• The 2020 Espnet Update: New Features, Broadened Applications, Performance Improvements, And Future Plans (2020)18.20
• Espnet-se: End-to-end Speech Enhancement And Separation Toolkit Designed For Asr Integration (2020)13.55
• Recent Developments On Espnet Toolkit Boosted By Conformer (2020)0.00
• Espnet-spk: Full Pipeline Speaker Embedding Toolkit With Reproducible Recipes, Self-supervised Front-ends, And Off-the-shelf Models (2024)0.00
• User-friendly Automatic Transcription Of Low-resource Languages: Plugging Espnet Into Elpis (2020)2.26
• EURO: Espnet Unsupervised ASR Open-source Toolkit (2022)6.77
• Espresso: A Fast End-to-end Neural Speech Recognition Toolkit (2019)0.00