Motionrag-diff: A Retrieval-augmented Diffusion Framework For Long-term Music-to-dance Generation

Abstract

Generating long-term, coherent, and realistic music-conditioned dance sequences remains a challenging task in human motion synthesis. Existing approaches exhibit critical limitations: motion graph methods rely on fixed template libraries, restricting creative generation; diffusion models, while capable of producing novel motions, often lack temporal coherence and musical alignment. To address these challenges, we propose \(\textbf\{MotionRAG-Diff\}\), a hybrid framework that integrates Retrieval-Augmented Generation (RAG) with diffusion-based refinement to enable high-quality, musically coherent dance generation for arbitrary long-term music inputs. Our method introduces three core innovations: (1) A cross-modal contrastive learning architecture that aligns heterogeneous music and dance representations in a shared latent space, establishing unsupervised semantic correspondence without paired data; (2) An optimized motion graph system for efficient retrieval and seamless concatenation o

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyhuang2025motionrag

Related papers

• Gaca-dit: Diffusion-based Dance-to-music Generation With Genre-adaptive Rhythm And Context-aware Alignment (2025)0.00
• Diff-a-riff: Musical Accompaniment Co-creation Via Latent Diffusion Models (2024)0.00
• Diffrhythm+: Controllable And Flexible Full-length Song Generation With Preference Optimization (2025)3.58
• Diffmotion: Speech-driven Gesture Synthesis Using Denoising Diffusion Model (2023)9.59
• Diffrhythm: Blazingly Fast And Embarrassingly Simple End-to-end Full-length Song Generation With Latent Diffusion (2025)0.00
• Conditional Diffusion As Latent Constraints For Controllable Symbolic Music Generation (2025)0.00
• Weakly Supervised Deep Recurrent Neural Networks For Basic Dance Step Generation (2018)12.17
• Diffsheg: A Diffusion-based Approach For Real-time Speech-driven Holistic 3D Expression And Gesture Generation (2024)0.00