Object Retrieval And Localization In Large Art Collections Using Deep Multi-style Feature Fusion And Iterative Voting

Abstract

The search for specific objects or motifs is essential to art history as both assist in decoding the meaning of artworks. Digitization has produced large art collections, but manual methods prove to be insufficient to analyze them. In the following, we introduce an algorithm that allows users to search for image regions containing specific motifs or objects and find similar regions in an extensive dataset, helping art historians to analyze large digitized art collections. Computer vision has presented efficient methods for visual instance retrieval across photographs. However, applied to art collections, they reveal severe deficiencies because of diverse motifs and massive domain shifts induced by differences in techniques, materials, and styles. In this paper, we present a multi-style feature fusion approach that successfully reduces the domain gap and improves retrieval results without labelled data or curated image collections. Our region-based voting with GPU-accelerated approximat

Stats

• citations9
• S2 citations—
• github stars0
• HF likes0
• heat score7.50
• arxiv keyufer2021object

Related papers

• Dynamic Spatial Verification For Large-scale Object-level Image Retrieval (2019)0.00
• Challenging Deep Image Descriptors For Retrieval In Heterogeneous Iconographic Collections (2019)5.84
• Museum Painting Retrieval (2021)0.00
• Visual Link Retrieval And Knowledge Discovery In Painting Datasets (2020)12.25
• Coarse2fine: Two-layer Fusion For Image Retrieval (2016)0.00
• DOLG: Single-stage Image Retrieval With Deep Orthogonal Fusion Of Local And Global Features (2021)15.95
• Aggregated Deep Local Features For Remote Sensing Image Retrieval (2019)14.11
• Exploiting Local Indexing And Deep Feature Confidence Scores For Fast Image-to-video Search (2018)2.26