Espnet: End-to-end Speech Processing Toolkit

Abstract

This paper introduces a new open source platform for end-to-end speech processing named ESPnet. ESPnet mainly focuses on end-to-end automatic speech recognition (ASR), and adopts widely-used dynamic neural network toolkits, Chainer and PyTorch, as a main deep learning engine. ESPnet also follows the Kaldi ASR toolkit style for data processing, feature extraction/format, and recipes to provide a complete setup for speech recognition and other speech processing experiments. This paper explains a major architecture of this software platform, several important functionalities, which differentiate ESPnet from other open source ASR toolkits, and experimental results with major ASR benchmarks.

Stats

• citations903
• S2 citations—
• github stars0
• HF likes0
• heat score22.17
• arxiv keywatanabe2018espnet

Related papers

• The 2020 Espnet Update: New Features, Broadened Applications, Performance Improvements, And Future Plans (2020)18.20
• Espnet-se: End-to-end Speech Enhancement And Separation Toolkit Designed For Asr Integration (2020)13.55
• Espnet-tts: Unified, Reproducible, And Integratable Open Source End-to-end Text-to-speech Toolkit (2019)23.32
• Espresso: A Fast End-to-end Neural Speech Recognition Toolkit (2019)0.00
• User-friendly Automatic Transcription Of Low-resource Languages: Plugging Espnet Into Elpis (2020)2.26
• Espnet-spk: Full Pipeline Speaker Embedding Toolkit With Reproducible Recipes, Self-supervised Front-ends, And Off-the-shelf Models (2024)0.00
• Espnet-se++: Speech Enhancement For Robust Speech Recognition, Translation, And Understanding (2022)18.72
• Recent Developments On Espnet Toolkit Boosted By Conformer (2020)0.00