Prosodic Parameter Manipulation In TTS Generated Speech For Controlled Speech Generation

Abstract

This paper explores the manipulation of prosodic parameters in Text-to-Speech (TTS) systems to achieve controlled speech generation. By leveraging advanced speech processing techniques, we compare TTS-generated audio with human-recorded speech to analyze differences in pitch, duration, and energy. Key features are extracted using tools like PyWorld and Librosa, which are then adjusted to align with the prosodic characteristics of natural human speech. The modified features undergo synthesis, producing enhanced TTS outputs that more closely mirror the natural prosody of human speech. This approach aims to enhance the naturalness and expressiveness of TTS systems by providing a framework for precise prosodic parameter adjustments. Our methodology involves feature extraction, prosodic manipulation, and synthesis, followed by comprehensive evaluations to ensure consistency with human speech patterns. The findings demonstrate the feasibility and effectiveness of prosodic parameter manipulat

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keychary2024prosodic

Related papers

• Controllable Neural Text-to-speech Synthesis Using Intuitive Prosodic Features (2020)11.76
• Controllable Prosody Generation With Partial Inputs (2023)3.58
• Dynamic Prosody Generation For Speech Synthesis Using Linguistics-driven Acoustic Embedding Selection (2019)7.81
• Prosody-controllable Spontaneous TTS With Neural Hmms (2022)8.09
• Hierarchical Prosody Modeling And Control In Non-autoregressive Parallel Neural TTS (2021)8.35
• Towards Controllable Speech Synthesis In The Era Of Large Language Models: A Systematic Survey (2024)4.75
• Stable-tts: Stable Speaker-adaptive Text-to-speech Synthesis Via Prosody Prompting (2024)4.52
• Drawspeech: Expressive Speech Synthesis Using Prosodic Sketches As Control Conditions (2025)4.52