Segment Relevance Estimation For Audio Analysis And Weakly-labelled Classification

Abstract

We propose a method that quantifies the importance, namely relevance, of audio segments for classification in weakly-labelled problems. It works by drawing information from a set of class-wise one-vs-all classifiers. By selecting the classifiers used in each specific classification problem, the relevance measure adapts to different user-defined viewpoints without requiring additional neural network training. This characteristic allows the relevance measure to highlight audio segments that quickly adapt to user-defined criteria. Such functionality can be used for computer-assisted audio analysis. Also, we propose a neural network architecture, namely RELNET, that leverages the relevance measure for weakly-labelled audio classification problems. RELNET was evaluated in the DCASE2018 dataset and achieved competitive classification results when compared to previous attention-based proposals.

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyfoleiss2019segment

Related papers

• Integrating Continuous And Binary Relevances In Audio-text Relevance Learning (2024)0.00
• Interpretable Representation Learning For Speech And Audio Signals Based On Relevance Weighting (2020)9.59
• Towards Relevance And Sequence Modeling In Language Recognition (2020)9.23
• Attention And Localization Based On A Deep Convolutional Recurrent Model For Weakly Supervised Audio Tagging (2017)11.39
• Text-based Audio Retrieval By Learning From Similarities Between Audio Captions (2024)2.26
• Robust Raw Waveform Speech Recognition Using Relevance Weighted Representations (2020)3.58
• Audio Scene Classification With Deep Recurrent Neural Networks (2017)11.29
• An Empirical Study Of Weakly Supervised Audio Tagging Embeddings For General Audio Representations (2022)0.00