Object Segmentation Tracking from Generic Video Cues
We propose a light-weight variational framework for online tracking of object segmentations in videos based on optical flow and image boundaries. While high-end computer vision methods on this task rely on sequence specific training of dedicated CNN architectures, we show the potential of a variational model, based on generic video information from motion and color. Such cues are usually required for tasks such as robot navigation or grasp estimation. We leverage them directly for video object segmentation and thus provide accurate segmentations at potentially very low extra cost. Our simple method can provide competitive results compared to the costly CNN-based methods with parameter tuning. Furthermore, we show that our approach can be combined with state-of-the-art CNN-based segmentations in order to improve over their respective results. We evaluate our method on the datasets DAVIS 16,17 and SegTrack v2.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectOptical Flow EstimationRobot NavigationSemantic SegmentationVideo Object SegmentationVideo Semantic SegmentationSimilar Papers 제목 키워드 기반
GOT-Edit: Geometry-Aware Generic Object Tracking via Online Model Editing
Human perception for effective object tracking in 2D video streams arises from the implicit use of prior 3D knowledge and semantic reasoning. In contrast, most generic object tracking (GOT) methods primarily rely on 2D f…
Object TrackingObject Detection, Tracking, and Motion Segmentation for Object-level Video Segmentation
We present an approach for object segmentation in videos that combines frame-level object detection with concepts from object tracking and motion segmentation. The approach extracts temporally consistent object tubes bas…
Motion SegmentationObjectobject-detectionObject Detection+5Proposal, Tracking and Segmentation (PTS): A Cascaded Network for Video Object Segmentation
Video object segmentation (VOS) aims at pixel-level object tracking given only the annotations in the first frame. Due to the large visual variations of objects in video and the lack of training samples, it remains a dif…
ObjectObject TrackingOne-shot visual object segmentationSegmentation+4Enhanced Kalman with Adaptive Appearance Motion SORT for Grounded Generic Multiple Object Tracking
Despite recent progress, Multi-Object Tracking (MOT) continues to face significant challenges, particularly its dependence on prior knowledge and predefined categories, complicating the tracking of unfamiliar objects. Ge…
Multi-Object TrackingMultiple Object TrackingObject Tracking3D-Aware Instance Segmentation and Tracking in Egocentric Videos
Egocentric videos present unique challenges for 3D scene understanding due to rapid camera motion, frequent object occlusions, and limited object visibility. This paper introduces a novel approach to instance segmentatio…
3D Object ReconstructionInstance SegmentationObjectObject Reconstruction+5