Blazingly Fast Video Object Segmentation With Pixel-wise Metric Learning
2018 · Yuhua Chen, Jordi Pont-Tuset, Alberto Montes, et al.
Abstract
This paper tackles the problem of video object segmentation, given some user annotation which indicates the object of interest. The problem is formulated as pixel-wise retrieval in a learned embedding space: we embed pixels of the same object instance into the vicinity of each other, using a fully convolutional network trained by a modified triplet loss as the embedding model. Then the annotated pixels are set as reference and the rest of the pixels are classified using a nearest-neighbor approach. The proposed method supports different kinds of user input such as segmentation mask in the first frame (semi-supervised scenario), or a sparse set of clicked points (interactive scenario). In the semi-supervised scenario, we achieve results competitive with the state of the art but at a fraction of computation cost (275 milliseconds per frame). In the interactive scenario where the user is able to refine their input iteratively, the proposed method provides instant response to each input, a
Authors
(none)
Tags
Stats
Related papers
- Less Than Few: Self-shot Video Instance Segmentation (2022)2.26
- Helping Hands: An Object-aware Ego-centric Video Recognition Model (2023)10.07
- Differentiable Resolution Compression And Alignment For Efficient Video Classification And Retrieval (2023)5.27
- Deep Similarity Metric Learning For Real-time Pedestrian Tracking (2018)0.00
- One Trajectory, One Token: Grounded Video Tokenization Via Panoptic Sub-object Trajectory (2025)0.00
- Centerclip: Token Clustering For Efficient Text-video Retrieval (2022)15.54
- Prompt Switch: Efficient CLIP Adaptation For Text-video Retrieval (2023)11.93
- Object-centric Representation Learning From Unlabeled Videos (2016)7.16