Hyper Recurrent Neural Network: Condition Mechanisms For Black-box Audio Effect Modeling

Abstract

Recurrent neural networks (RNNs) have demonstrated impressive results for virtual analog modeling of audio effects. These networks process time-domain audio signals using a series of matrix multiplication and nonlinear activation functions to emulate the behavior of the target device accurately. To additionally model the effect of the knobs for an RNN-based model, existing approaches integrate control parameters by concatenating them channel-wisely with some intermediate representation of the input signal. While this method is parameter-efficient, there is room to further improve the quality of generated audio because the concatenation-based conditioning method has limited capacity in modulating signals. In this paper, we propose three novel conditioning mechanisms for RNNs, tailored for black-box virtual analog modeling. These advanced conditioning mechanisms modulate the model based on control parameters, yielding superior results to existing RNN- and CNN-based architectures across v

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyyeh2024hyper

Related papers

• Comparative Study Of State-based Neural Networks For Virtual Analog Audio Effects Modeling (2024)2.26
• Efficient Neural Networks For Real-time Modeling Of Analog Dynamic Range Compression (2021)0.00
• High Order Recurrent Neural Networks For Acoustic Modelling (2018)8.60
• Targeted Adversarial Examples For Black Box Audio Systems (2018)15.75
• Conditional Variational Autoencoder To Improve Neural Audio Synthesis For Polyphonic Music Sound (2022)0.00
• Gated Recurrent Unit Based Acoustic Modeling With Future Context (2018)7.16
• Efficient Neural Audio Synthesis (2018)0.00
• Towards Lightweight Controllable Audio Synthesis With Conditional Implicit Neural Representations (2021)0.00