Streaming Piano Transcription Based On Consistent Onset And Offset Decoding With Sustain Pedal Detection

Abstract

This paper describes a streaming audio-to-MIDI piano transcription approach that aims to sequentially translate a music signal into a sequence of note onset and offset events. The sequence-to-sequence nature of this task may call for the computationally-intensive transformer model for better performance, which has recently been used for offline transcription benchmarks and could be extended for streaming transcription with causal attention mechanisms. We assume that the performance limitation of this naive approach lies in the decoder. Although time-frequency features useful for onset detection are considerably different from those for offset detection, the single decoder is trained to output a mixed sequence of onset and offset events without guarantee of the correspondence between the onset and offset events of the same note. To overcome this limitation, we propose a streaming encoder-decoder model that uses a convolutional encoder aggregating local acoustic features, followed by an

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keywei2025streaming

Related papers

• Towards Efficient And Real-time Piano Transcription Using Neural Autoregressive Models (2024)5.84
• Piano Transcription By Hierarchical Language Modeling With Pretrained Roll-based Encoders (2025)4.52
• Deep Polyphonic ADSR Piano Note Transcription (2019)11.29
• Hppnet: Modeling The Harmonic Structure And Pitch Invariance In Piano Transcription (2022)0.00
• End-to-end Real-world Polyphonic Piano Audio-to-score Transcription With Hierarchical Decoding (2024)0.00
• Audio-to-score Alignment Of Piano Music Using Rnn-based Automatic Music Transcription (2017)0.00
• Note-level Singing Melody Transcription For Time-aligned Musical Score Generation (2025)5.24
• Adversarial Learning For Improved Onsets And Frames Music Transcription (2019)0.00