Generating Lead Sheets With Affect: A Novel Conditional Seq2seq Framework

Abstract

The field of automatic music composition has seen great progress in the last few years, much of which can be attributed to advances in deep neural networks. There are numerous studies that present different strategies for generating sheet music from scratch. The inclusion of high-level musical characteristics (e.g., perceived emotional qualities), however, as conditions for controlling the generation output remains a challenge. In this paper, we present a novel approach for calculating the valence (the positivity or negativity of the perceived emotion) of a chord progression within a lead sheet, using pre-defined mood tags proposed by music experts. Based on this approach, we propose a novel strategy for conditional lead sheet generation that allows us to steer the music generation in terms of valence, phrasing, and time signature. Our approach is similar to a Neural Machine Translation (NMT) problem, as we include high-level conditions in the encoder part of the sequence-to-sequence a

Stats

• citations13
• S2 citations—
• github stars0
• HF likes0
• heat score8.60
• arxiv keymakris2021generating

Related papers

• Melody-conditioned Lyrics Generation With Seqgans (2020)7.50
• The Effect Of Explicit Structure Encoding Of Deep Neural Networks For Symbolic Music Generation (2018)11.49
• Chord Generation From Symbolic Melody Using BLSTM Networks (2017)0.00
• Neural Melody Composition From Lyrics (2018)9.59
• Songmass: Automatic Song Writing With Pre-training And Alignment Constraint (2020)11.39
• CSL-L2M: Controllable Song-level Lyric-to-melody Generation Based On Conditional Transformer With Fine-grained Lyric And Musical Controls (2024)2.26
• Segtune: Structured And Fine-grained Control For Song Generation (2025)0.00
• Polyphonic Music Generation With Sequence Generative Adversarial Networks (2017)2.26