Category-level Pose Retrieval With Contrastive Features Learnt With Occlusion Augmentation

Abstract

Pose estimation is usually tackled as either a bin classification or a regression problem. In both cases, the idea is to directly predict the pose of an object. This is a non-trivial task due to appearance variations between similar poses and similarities between dissimilar poses. Instead, we follow the key idea that comparing two poses is easier than directly predicting one. Render-and-compare approaches have been employed to that end, however, they tend to be unstable, computationally expensive, and slow for real-time applications. We propose doing category-level pose estimation by learning an alignment metric in an embedding space using a contrastive loss with a dynamic margin and a continuous pose-label space. For efficient inference, we use a simple real-time image retrieval scheme with a pre-rendered and pre-embedded reference set of renderings. To achieve robustness to real-world conditions, we employ synthetic occlusions, bounding box perturbations, and appearance augmentations

Stats

• citations0
• S2 citations—
• github stars8
• HF likes0
• heat score1.91
• arxiv keykouros2022category

Related papers

• Dual Pose-invariant Embeddings: Learning Category And Object-specific Discriminative Representations For Recognition And Retrieval (2024)4.52
• View-invariant, Occlusion-robust Probabilistic Embedding For Human Pose (2020)8.82
• Evaluating Contrastive Models For Instance-based Image Retrieval (2021)5.24
• Semantic Pose Verification For Outdoor Visual Localization With Self-supervised Contrastive Learning (2022)8.35
• Multiview-consistent Semi-supervised Learning For 3D Human Pose Estimation (2019)13.05
• 3D Pose Estimation And 3D Model Retrieval For Objects In The Wild (2018)15.25
• C-BEV: Contrastive Bird's Eye View Training For Cross-view Image Retrieval And 3-dof Pose Estimation (2023)0.00
• A Pose-sensitive Embedding For Person Re-identification With Expanded Cross Neighborhood Re-ranking (2017)23.25