Machine Learning Framework For Audio-based Content Evaluation Using MFCC, Chroma, Spectral Contrast, And Temporal Feature Engineering

Abstract

This study presents a machine learning framework for assessing similarity between audio content and predicting sentiment score. We construct a dataset containing audio samples from music covers on YouTube along with the audio of the original song, and sentiment scores derived from user comments, serving as proxy labels for content quality. Our approach involves extensive pre-processing, segmenting audio signals into 30-second windows, and extracting high-dimensional feature representations through Mel-Frequency Cepstral Coefficients (MFCC), Chroma, Spectral Contrast, and Temporal characteristics. Leveraging these features, we train regression models to predict sentiment scores on a 0-100 scale, achieving root mean square error (RMSE) values of 3.420, 5.482, 2.783, and 4.212, respectively. Improvements over a baseline model based on absolute difference metrics are observed. These results demonstrate the potential of machine learning to capture sentiment and similarity in audio, offering

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyaristorenas2024machine

Related papers

• A Multimodal Approach Towards Emotion Recognition Of Music Using Audio And Lyrical Content (2018)0.00
• Multi-modality In Music: Predicting Emotion In Music From High-level Audio Features And Lyrics (2023)0.00
• Music Mood Detection Based On Audio And Lyrics With Deep Neural Net (2018)0.00
• Learning Robust Heterogeneous Signal Features From Parallel Neural Network For Audio Sentiment Analysis (2018)0.00
• Exploiting Synchronized Lyrics And Vocal Features For Music Emotion Detection (2019)0.00
• Human Vocal Sentiment Analysis (2019)0.00
• Supervised And Unsupervised Learning Of Audio Representations For Music Understanding (2022)0.00
• Audio-guided Fusion Techniques For Multimodal Emotion Analysis (2024)4.52