Multi-scale Convolutions For Learning Context Aware Feature Representations

Abstract

Finding semantic correspondences is a challenging problem. With the breakthrough of CNNs stronger features are available for tasks like classification but not specifically for the requirements of semantic matching. In the following we present a weakly supervised metric learning approach which generates stronger features by encoding far more context than previous methods. First, we generate more suitable training data using a geometrically informed correspondence mining method which is less prone to spurious matches and requires only image category labels as supervision. Second, we introduce a new convolutional layer which is a learned mixture of differently strided convolutions and allows the network to encode implicitly more context while preserving matching accuracy at the same time. The strong geometric encoding on the feature side enables us to learn a semantic flow network, which generates more natural deformations than parametric transformation based models and is able to jointly

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyufer2019multi

Related papers

• Hierarchical Metric Learning And Matching For 2D And 3D Geometric Correspondences (2018)11.39
• Leveraging Semantic Cues From Foundation Vision Models For Enhanced Local Feature Correspondence (2024)5.24
• Digging Into Self-supervised Learning Of Feature Descriptors (2021)7.16
• Self-supervised Visual Representations For Cross-modal Retrieval (2019)7.50
• Learning-based Efficient Graph Similarity Computation Via Multi-scale Convolutional Set Matching (2018)13.60
• Class-weighted Convolutional Features For Visual Instance Search (2017)12.81
• Supervised Metric Learning To Rank For Retrieval Via Contextual Similarity Optimization (2022)2.64
• Co-occurrence Of Deep Convolutional Features For Image Search (2020)9.76