DEEPF0: End-to-end Fundamental Frequency Estimation For Music And Speech Signals

Abstract

We propose a novel pitch estimation technique called DeepF0, which leverages the available annotated data to directly learns from the raw audio in a data-driven manner. F0 estimation is important in various speech processing and music information retrieval applications. Existing deep learning models for pitch estimations have relatively limited learning capabilities due to their shallow receptive field. The proposed model addresses this issue by extending the receptive field of a network by introducing the dilated convolutional blocks into the network. The dilation factor increases the network receptive field exponentially without increasing the parameters of the model exponentially. To make the training process more efficient and faster, DeepF0 is augmented with residual blocks with residual connections. Our empirical evaluation demonstrates that the proposed model outperforms the baselines in terms of raw pitch accuracy and raw chroma accuracy even using 77.4% fewer network parameter

Stats

• citations23
• S2 citations—
• github stars0
• HF likes0
• heat score10.35
• arxiv keysingh2021deepf0

Related papers

• Traditional Machine Learning For Pitch Detection (2019)10.85
• Hf0: A Hybrid Pitch Extraction Method For Multimodal Voice (2019)0.00
• Real-time Pitch/f0 Detection Using Spectrogram Images And Convolutional Neural Networks (2025)0.00
• A Regression Model Of Recurrent Deep Neural Networks For Noise Robust Estimation Of The Fundamental Frequency Contour Of Speech (2018)4.52
• Waveform To Single Sinusoid Regression To Estimate The F0 Contour From Noisy Speech Using Recurrent Deep Neural Networks (2018)6.77
• Noisy Speech Based Temporal Decomposition To Improve Fundamental Frequency Estimation (2021)5.24
• MF-PAM: Accurate Pitch Estimation Through Periodicity Analysis And Multi-level Feature Fusion (2023)0.00
• Multiple F0 Estimation In Vocal Ensembles Using Convolutional Neural Networks (2020)0.00