A Deep Learning Approach To Clustering Visual Arts

Abstract

Clustering artworks is difficult for several reasons. On the one hand, recognizing meaningful patterns based on domain knowledge and visual perception is extremely hard. On the other hand, applying traditional clustering and feature reduction techniques to the highly dimensional pixel space can be ineffective. To address these issues, in this paper we propose DELIUS: a DEep learning approach to cLustering vIsUal artS. The method uses a pre-trained convolutional network to extract features and then feeds these features into a deep embedded clustering model, where the task of mapping the input data to a latent space is jointly optimized with the task of finding a set of cluster centroids in this latent space. Quantitative and qualitative experimental results show the effectiveness of the proposed method. DELIUS can be useful for several tasks related to art analysis, in particular visual link retrieval and historical knowledge discovery in painting datasets.

Stats

• citations25
• S2 citations—
• github stars0
• HF likes0
• heat score10.61
• arxiv keycastellano2021a

Related papers

• Deep Convolutional Embedding For Digitized Painting Clustering (2020)7.50
• Visual Link Retrieval And Knowledge Discovery In Painting Datasets (2020)12.25
• Leveraging Computer Vision Application In Visual Arts: A Case Study On The Use Of Residual Neural Network To Classify And Analyze Baroque Paintings (2022)3.58
• Object Retrieval And Localization In Large Art Collections Using Deep Multi-style Feature Fusion And Iterative Voting (2021)7.50
• Challenging Deep Image Descriptors For Retrieval In Heterogeneous Iconographic Collections (2019)5.84
• Context-aware Embeddings For Automatic Art Analysis (2019)12.54
• ICC++: Explainable Image Retrieval For Art Historical Corpora Using Image Composition Canvas (2022)0.00
• Artseek: Deep Artwork Understanding Via Multimodal In-context Reasoning And Late Interaction Retrieval (2025)2.16