Melody-conditioned Lyrics Generation With Seqgans

Abstract

Automatic lyrics generation has received attention from both music and AI communities for years. Early rule-based approaches have~---due to increases in computational power and evolution in data-driven models---~mostly been replaced with deep-learning-based systems. Many existing approaches, however, either rely heavily on prior knowledge in music and lyrics writing or oversimplify the task by largely discarding melodic information and its relationship with the text. We propose an end-to-end melody-conditioned lyrics generation system based on Sequence Generative Adversarial Networks (SeqGAN), which generates a line of lyrics given the corresponding melody as the input. Furthermore, we investigate the performance of the generator with an additional input condition: the theme or overarching topic of the lyrics to be generated. We show that the input conditions have no negative impact on the evaluation metrics while enabling the network to produce more meaningful results.

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keychen2020melody

Related papers

• Conditional LSTM-GAN For Melody Generation From Lyrics (2019)14.69
• Interpretable Melody Generation From Lyrics With Discrete-valued Adversarial Training (2022)6.34
• Unsupervised Melody-to-lyric Generation (2023)0.00
• A Syllable-structured, Contextually-based Conditionally Generation Of Chinese Lyrics (2019)7.16
• Joint Learning Of Wording And Formatting For Singable Melody-to-lyric Generation (2023)0.00
• Neural Melody Composition From Lyrics (2018)9.59
• CSL-L2M: Controllable Song-level Lyric-to-melody Generation Based On Conditional Transformer With Fine-grained Lyric And Musical Controls (2024)2.26
• Songglm: Lyric-to-melody Generation With 2D Alignment Encoding And Multi-task Pre-training (2024)3.58