Diverse Melody Generation From Chinese Lyrics Via Mutual Information Maximization

Abstract

In this paper, we propose to adapt the method of mutual information maximization into the task of Chinese lyrics conditioned melody generation to improve the generation quality and diversity. We employ scheduled sampling and force decoding techniques to improve the alignment between lyrics and melodies. With our method, which we called Diverse Melody Generation (DMG), a sequence-to-sequence model learns to generate diverse melodies heavily depending on the input style ids, while keeping the tonality and improving the alignment. The experimental results of subjective tests show that DMG can generate more pleasing and coherent tunes than baseline methods.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyyuan2020diverse

Related papers

• A Syllable-structured, Contextually-based Conditionally Generation Of Chinese Lyrics (2019)7.16
• Songglm: Lyric-to-melody Generation With 2D Alignment Encoding And Multi-task Pre-training (2024)3.58
• Interpretable Melody Generation From Lyrics With Discrete-valued Adversarial Training (2022)6.34
• Unsupervised Melody-to-lyric Generation (2023)0.00
• Neural Melody Composition From Lyrics (2018)9.59
• Conditional LSTM-GAN For Melody Generation From Lyrics (2019)14.69
• CSL-L2M: Controllable Song-level Lyric-to-melody Generation Based On Conditional Transformer With Fine-grained Lyric And Musical Controls (2024)2.26
• Melody-conditioned Lyrics Generation With Seqgans (2020)7.50