Unspeech: Unsupervised Speech Context Embeddings

Abstract

We introduce "Unspeech" embeddings, which are based on unsupervised learning of context feature representations for spoken language. The embeddings were trained on up to 9500 hours of crawled English speech data without transcriptions or speaker information, by using a straightforward learning objective based on context and non-context discrimination with negative sampling. We use a Siamese convolutional neural network architecture to train Unspeech embeddings and evaluate them on speaker comparison, utterance clustering and as a context feature in TDNN-HMM acoustic models trained on TED-LIUM, comparing it to i-vector baselines. Particularly decoding out-of-domain speech data from the recently released Common Voice corpus shows consistent WER reductions. We release our source code and pre-trained Unspeech models under a permissive open source license.

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keymilde2018unspeech

Related papers

• Stuttering Detection Using Speaker Representations And Self-supervised Contextual Embeddings (2023)6.34
• Evaluating Context-invariance In Unsupervised Speech Representations (2022)0.00
• Unispeech: Unified Speech Representation Learning With Labeled And Unlabeled Data (2021)0.00
• Bootstrapping Meaning Through Listening: Unsupervised Learning Of Spoken Sentence Embeddings (2022)2.26
• Non-contrastive Self-supervised Learning For Utterance-level Information Extraction From Speech (2022)9.59
• Pushing The Limits Of Unsupervised Unit Discovery For SSL Speech Representation (2023)6.34
• Unsupervised Speech Enhancement With Speech Recognition Embedding And Disentanglement Losses (2021)8.35
• Towards Learning A Universal Non-semantic Representation Of Speech (2020)14.43