Deep Convolutional Embedding For Digitized Painting Clustering

Abstract

Clustering artworks is difficult for several reasons. On the one hand, recognizing meaningful patterns in accordance with domain knowledge and visual perception is extremely difficult. On the other hand, applying traditional clustering and feature reduction techniques to the highly dimensional pixel space can be ineffective. To address these issues, we propose to use a deep convolutional embedding model for digitized painting clustering, in which the task of mapping the raw input data to an abstract, latent space is jointly optimized with the task of finding a set of cluster centroids in this latent feature space. Quantitative and qualitative experimental results show the effectiveness of the proposed method. The model is also capable of outperforming other state-of-the-art deep clustering approaches to the same problem. The proposed method can be useful for several art-related tasks, in particular visual link retrieval and historical knowledge discovery in painting datasets.

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keycastellano2020deep

Related papers

• A Deep Learning Approach To Clustering Visual Arts (2021)10.61
• Visual Link Retrieval And Knowledge Discovery In Painting Datasets (2020)12.25
• Leveraging Computer Vision Application In Visual Arts: A Case Study On The Use Of Residual Neural Network To Classify And Analyze Baroque Paintings (2022)3.58
• ICC++: Explainable Image Retrieval For Art Historical Corpora Using Image Composition Canvas (2022)0.00
• Object Retrieval And Localization In Large Art Collections Using Deep Multi-style Feature Fusion And Iterative Voting (2021)7.50
• Context-aware Embeddings For Automatic Art Analysis (2019)12.54
• Fuse And Attend: Generalized Embedding Learning For Art And Sketches (2022)0.00
• Challenging Deep Image Descriptors For Retrieval In Heterogeneous Iconographic Collections (2019)5.84