MuST-C

MuST-C is a dataset used to evaluate simultaneous speech-to-speech translation across multiple languages, focusing on the quality-latency trade-off in long-form continuous speech scenarios.

Papers using MuST-C (53)

STEMM: Self-learning With Speech-text Manifold Mixup For Speech Translation2022 · 75 citesSpeechut: Bridging Speech And Text With Hidden-unit For Encoder-decoder Based Speech-text Pre-training2022 · 38 citesEfficient Sequence Transduction By Jointly Predicting Tokens And Durations2023 · 6 citesSimulU: Training-free Policy for Long-form Simultaneous Speech-to-Speech Translation2026Rethinking And Improving Multi-task Learning For End-to-end Speech Translation2023 · 5 citesAn Empirical Study Of Consistency Regularization For End-to-end Speech-to-text Translation2023 · 3 citesBridging The Gaps Of Both Modality And Language: Synchronous Bilingual CTC For Speech Translation And Speech Recognition2023 · 1 citesOptimal Multi-Task Learning at Regularization Horizon for Speech Translation Task2025Optimizing Speech Multi-view Feature Fusion Through Conditional Computation2025InfiniSST: Simultaneous Translation of Unbounded Speech with Large Language Model2025Optimizing Speech Multi-View Feature Fusion through Conditional Computation2025Speech Translation Refinement using Large Language Models2025Improving End-to-end Speech Translation By Imitation-based Knowledge Distillation With Synthetic Transcripts2023Adatrans: Adapting With Boundary-based Shrinking For End-to-end Speech Translation2022 · 2 citesImplicit Memory Transformer For Computationally Efficient Simultaneous Speech Translation2023 · 1 citesSpeech Translation With Foundation Models And Optimal Transport: UPC At IWSLT232023 · 1 citesShiftable Context: Addressing Training-inference Context Mismatch In Simultaneous Speech Translation2023M3ST: Mix at Three Levels for Speech Translation2022 · 14 citesPre-training for Speech Translation: CTC Meets Optimal Transport2023 · 7 citesEfficient Sequence Transduction by Jointly Predicting Tokens and Durations2023 · 6 citesSpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training2022 · 3 citesSimple and Effective Unsupervised Speech Translation2022 · 2 citesAdaTranS: Adapting with Boundary-based Shrinking for End-to-End Speech Translation2022 · 2 citesWACO: Word-Aligned Contrastive Learning for Speech Translation2022 · 2 citesTuning Large language model for End-to-end Speech Translation2023 · 2 citesEfficient Speech Translation with Dynamic Latent Perceivers2022 · 1 citesSegAugment: Maximizing the Utility of Speech Translation Data with Segmentation-based Augmentations2022 · 1 citesHybrid Transducer and Attention based Encoder-Decoder Modeling for Speech-to-Text Tasks2023 · 1 citesUnderstanding and Bridging the Modality Gap for Speech Translation2023 · 1 citesCMOT: Cross-modal Mixup via Optimal Transport for Speech Translation2023 · 1 citesSoft Alignment of Modality Space for End-to-end Speech Translation2023 · 1 citesFASST: Fast LLM-based Simultaneous Speech Translation2024 · 1 citesGenerating Synthetic Speech from SpokenVocab for Speech Translation2022RedApt: An Adaptor for wav2vec 2 Encoding \\ Faster and Smaller Speech Translation without Quality Compromise2022Decouple Non-parametric Knowledge Distillation For End-to-end Speech Translation2023Improving speech translation by fusing speech and text2023CTC-based Non-autoregressive Speech Translation2023Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT232023Modality Adaption or Regularization? A Case Study on End-to-End Speech Translation2023Shiftable Context: Addressing Training-Inference Context Mismatch in Simultaneous Speech Translation2023Implicit Memory Transformer for Computationally Efficient Simultaneous Speech Translation2023Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts2023An Empirical Study of Consistency Regularization for End-to-End Speech-to-Text Translation2023Bridging the Gaps of Both Modality and Language: Synchronous Bilingual CTC for Speech Translation and Speech Recognition2023Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing2023Rethinking and Improving Multi-task Learning for End-to-end Speech Translation2023Pushing the Limits of Zero-shot End-to-End Speech Translation2024SimulTron: On-Device Simultaneous Speech to Speech Translation2024Task Arithmetic for Language Expansion in Speech Translation2024Representation Purification for End-to-End Speech Translation2024On the Impact of Noises in Crowd-Sourced Data for Speech Translation2022Improving Speech Translation by Cross-Modal Multi-Grained Contrastive Learning2023Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff2023