Weakly Supervised Deep Recurrent Neural Networks For Basic Dance Step Generation

Abstract

Synthesizing human's movements such as dancing is a flourishing research field which has several applications in computer graphics. Recent studies have demonstrated the advantages of deep neural networks (DNNs) for achieving remarkable performance in motion and music tasks with little effort for feature pre-processing. However, applying DNNs for generating dance to a piece of music is nevertheless challenging, because of 1) DNNs need to generate large sequences while mapping the music input, 2) the DNN needs to constraint the motion beat to the music, and 3) DNNs require a considerable amount of hand-crafted data. In this study, we propose a weakly supervised deep recurrent method for real-time basic dance generation with audio power spectrum as input. The proposed model employs convolutional layers and a multilayered Long Short-Term memory (LSTM) to process the audio input. Then, another deep LSTM layer decodes the target dance sequence. Notably, this end-to-end approach has 1) an aut

Stats

• citations41
• S2 citations—
• github stars0
• HF likes0
• heat score12.17
• arxiv keyyalta2018weakly

Related papers

• Motionrag-diff: A Retrieval-augmented Diffusion Framework For Long-term Music-to-dance Generation (2025)0.00
• The Effect Of Explicit Structure Encoding Of Deep Neural Networks For Symbolic Music Generation (2018)11.49
• Sample-level Deep Convolutional Neural Networks For Music Auto-tagging Using Raw Waveforms (2017)0.00
• Rethinking Recurrent Latent Variable Model For Music Composition (2018)7.50
• Gesture2music: A Low-latency Real-time Framework For Continuous Gesture-driven Music Generation (2026)0.00
• Bigwavgan: A Wave-to-wave Generative Adversarial Network For Music Super-resolution (2023)0.00
• Semi-recurrent Cnn-based VAE-GAN For Sequential Data Generation (2018)10.21
• Gaca-dit: Diffusion-based Dance-to-music Generation With Genre-adaptive Rhythm And Context-aware Alignment (2025)0.00