Video Object Segmentation through Spatially Accurate and Temporally Dense Extraction of Primary Object Regions
In this paper, we propose a novel approach to extract primary object segments in videos in the 'object proposal' domain. The extracted primary object regions are then used to build object models for optimized video segmentation. The proposed approach has several contributions: First, a novel layered Directed Acyclic Graph (DAG) based framework is presented for detection and segmentation of the primary object in video. We exploit the fact that, in general, objects are spatially cohesive and characterized by locally smooth motion trajectories, to extract the primary object from the set of all available proposals based on motion, appearance and predicted-shape similarity across frames. Second, the DAG is initialized with an enhanced object proposal set where motion based proposal predictions (from adjacent frames) are used to expand the set of object proposals for a particular frame. Last, the paper presents a motion scoring function for selection of object proposals that emphasizes high optical flow gradients at proposal boundaries to discriminate between moving objects and the background. The proposed approach is evaluated using several challenging benchmark videos and it outperforms both unsupervised and supervised state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
ObjectOptical Flow EstimationSemantic SegmentationVideo Object SegmentationVideo SegmentationVideo Semantic SegmentationSimilar Papers 제목 키워드 기반
Coherent Parametric Contours for Interactive Video Object Segmentation
Interactive video segmentation systems aim at producing sub-pixel-level object boundaries for visual effect applications. Recent approaches mainly focus on using sparse user input (i.e. scribbles) for efficient segmentat…
Interactive Video Object SegmentationObjectSegmentationSemantic Segmentation+3GSVNet: Guided Spatially-Varying Convolution for Fast Semantic Segmentation on Video
This paper addresses fast semantic segmentation on video.Video segmentation often calls for real-time, or even fasterthan real-time, processing. One common recipe for conserving computation arising from feature extractio…
Image SegmentationSegmentationSemantic SegmentationVideo Segmentation+1HOIST-Former: Hand-held Objects Identification Segmentation and Tracking in the Wild
We address the challenging task of identifying segmenting and tracking hand-held objects which is crucial for applications such as human action segmentation and performance evaluation. This task is particularly chall…
Action SegmentationSegmentationPReMVOS: Proposal-generation, Refinement and Merging for Video Object Segmentation
We address semi-supervised video object segmentation, the task of automatically generating accurate and consistent pixel masks for objects in a video sequence, given the first-frame ground truth annotations. Towards this…
ObjectOne-shot visual object segmentationSegmentationSemantic Segmentation+3HOIST-Former: Hand-held Objects Identification, Segmentation, and Tracking in the Wild
We address the challenging task of identifying, segmenting, and tracking hand-held objects, which is crucial for applications such as human action segmentation and performance evaluation. This task is particularly challe…
Action SegmentationSegmentation