Wave-u-mamba: An End-to-end Framework For High-quality And Efficient Speech Super Resolution

Abstract

Speech Super-Resolution (SSR) is a task of enhancing low-resolution speech signals by restoring missing high-frequency components. Conventional approaches typically reconstruct log-mel features, followed by a vocoder that generates high-resolution speech in the waveform domain. However, as mel features lack phase information, this can result in performance degradation during the reconstruction phase. Motivated by recent advances with Selective State Spaces Models (SSMs), we propose a method, referred to as Wave-U-Mamba that directly performs SSR in time domain. In our comparative study, including models such as WSRGlow, NU-Wave 2, and AudioSR, Wave-U-Mamba demonstrates superior performance, achieving the lowest Log-Spectral Distance (LSD) across various low-resolution sampling rates, ranging from 8 to 24 kHz. Additionally, subjective human evaluations, scored using Mean Opinion Score (MOS) reveal that our method produces SSR with natural and human-like quality. Furthermore, Wave-U-Mamb

Stats

• citations2
• S2 citations—
• github stars0
• HF likes0
• heat score3.58
• arxiv keylee2024wave

Related papers

• Super Denoise Net: Speech Super Resolution With Noise Cancellation In Low Sampling Rate Noisy Environments (2023)0.00
• Neural Vocoder Is All You Need For Speech Super-resolution (2022)12.25
• STSR: High-fidelity Speech Super-resolution Via Spectral-transient Context Modeling (2025)0.00
• High-quality Speech Synthesis Using Super-resolution Mel-spectrogram (2019)0.00
• Mdctgan: Taming Transformer-based GAN For Speech Super-resolution With Modified DCT Spectra (2023)3.65
• Improved Speech Enhancement With The Wave-u-net (2018)0.00
• Universr: Unified And Versatile Audio Super-resolution Via Vocoder-free Flow Matching (2025)0.00
• Mamba-seunet: Mamba Unet For Monaural Speech Enhancement (2024)7.16