Self-supervised Contrastive Learning For Unsupervised Phoneme Segmentation
2020 · Felix Kreuk, Joseph Keshet, Yossi Adi
Abstract
We propose a self-supervised representation learning model for the task of unsupervised phoneme boundary detection. The model is a convolutional neural network that operates directly on the raw waveform. It is optimized to identify spectral changes in the signal using the Noise-Contrastive Estimation principle. At test time, a peak detection algorithm is applied over the model outputs to produce the final boundaries. As such, the proposed model is trained in a fully unsupervised manner with no manual annotations in the form of target boundaries nor phonetic transcriptions. We compare the proposed approach to several unsupervised baselines using both TIMIT and Buckeye corpora. Results suggest that our approach surpasses the baseline models and reaches state-of-the-art performance on both data sets. Furthermore, we experimented with expanding the training set with additional examples from the Librispeech corpus. We evaluated the resulting model on distributions and languages that were no
Authors
(none)
Tags
Stats
Related papers
- Segmental Contrastive Predictive Coding For Unsupervised Word Segmentation (2021)0.00
- Unsupervised Speech Segmentation And Variable Rate Representation Learning Using Segmental Contrastive Predictive Coding (2021)9.92
- Back To Supervision: Boosting Word Boundary Detection Through Frame Classification (2024)0.00
- Unsupervised Speech Recognition Via Segmental Empirical Output Distribution Matching (2018)0.00
- Contrastive Prediction Strategies For Unsupervised Segmentation And Categorization Of Phonemes And Words (2021)9.23
- Syllable Discovery And Cross-lingual Generalization In A Visually Grounded, Self-supervised Speech Model (2023)7.81
- Contrastive Separative Coding For Self-supervised Representation Learning (2021)0.00
- Self-supervised Learning From Contrastive Mixtures For Personalized Speech Enhancement (2020)0.00