How Low Can You Go? Reducing Frequency And Time Resolution In Current CNN Architectures For Music Auto-tagging

Abstract

Automatic tagging of music is an important research topic in Music Information Retrieval and audio analysis algorithms proposed for this task have achieved improvements with advances in deep learning. In particular, many state-of-the-art systems use Convolutional Neural Networks and operate on mel-spectrogram representations of the audio. In this paper, we compare commonly used mel-spectrogram representations and evaluate model performances that can be achieved by reducing the input size in terms of both lesser amount of frequency bands and larger frame rates. We use the MagnaTagaTune dataset for comprehensive performance comparisons and then compare selected configurations on the larger Million Song Dataset. The results of this study can serve researchers and practitioners in their trade-off decision between accuracy of the models, data storage size and training and inference times.

Stats

• citations3
• S2 citations—
• github stars0
• HF likes0
• heat score4.52
• arxiv keyferraro2019how

Related papers

• Sample-level CNN Architectures For Music Auto-tagging Using Raw Waveforms (2017)13.23
• Automatic Tagging Using Deep Convolutional Neural Networks (2016)0.00
• Sample-level Deep Convolutional Neural Networks For Music Auto-tagging Using Raw Waveforms (2017)0.00
• Multi-level And Multi-scale Feature Aggregation Using Pre-trained Convolutional Neural Networks For Music Auto-tagging (2017)15.43
• Convolutional Recurrent Neural Networks For Music Classification (2016)18.98
• Perceptual Musical Features For Interpretable Audio Tagging (2023)5.24
• Reducing Model Complexity For DNN Based Large-scale Audio Classification (2017)9.59
• Convolutional Gated Recurrent Neural Network Incorporating Spatial Features For Audio Tagging (2017)13.23