Exploiting Pre-trained Feature Networks For Generative Adversarial Networks In Audio-domain Loop Generation

Abstract

While generative adversarial networks (GANs) have been widely used in research on audio generation, the training of a GAN model is known to be unstable, time consuming, and data inefficient. Among the attempts to ameliorate the training process of GANs, the idea of Projected GAN emerges as an effective solution for GAN-based image generation, establishing the state-of-the-art in different image applications. The core idea is to use a pre-trained classifier to constrain the feature space of the discriminator to stabilize and improve GAN training. This paper investigates whether Projected GAN can similarly improve audio generation, by evaluating the performance of a StyleGAN2-based audio-domain loop generation model with and without using a pre-trained feature space in the discriminator. Moreover, we compare the performance of using a general versus domain-specific classifier as the pre-trained audio classifier. With experiments on both drum loop and synth loop generation, we show that a

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyyeh2022exploiting

Related papers

• Bandwidth Extension On Raw Audio Via Generative Adversarial Networks (2019)0.00
• Adversarial Audio Synthesis (2018)0.00
• Gansynth: Adversarial Neural Audio Synthesis (2019)0.00
• Fine-tuning Of Pre-trained End-to-end Speech Recognition With Generative Adversarial Networks (2021)5.84
• Voice Command Generation Using Progressive Wavegans (2019)0.00
• A Benchmarking Initiative For Audio-domain Music Generation Using The Freesound Loop Dataset (2021)0.00
• Adversarial Generation Of Time-frequency Features With Application In Audio Synthesis (2019)0.00
• Audioldm 2: Learning Holistic Audio Generation With Self-supervised Pretraining (2023)0.00