An Efficient 3D CNN for Action/Object Segmentation in Video
Convolutional Neural Network (CNN) based image segmentation has made great progress in recent years. However, video object segmentation remains a challenging task due to its high computational complexity. Most of the previous methods employ a two-stream CNN framework to handle spatial and motion features separately. In this paper, we propose an end-to-end encoder-decoder style 3D CNN to aggregate spatial and temporal information simultaneously for video object segmentation. To efficiently process video, we propose 3D separable convolution for the pyramid pooling module and decoder, which dramatically reduces the number of operations while maintaining the performance. Moreover, we also extend our framework to video action segmentation by adding an extra classifier to predict the action label for actors in videos. Extensive experiments on several video datasets demonstrate the superior performance of the proposed approach for action and object segmentation compared to the state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
Action SegmentationDecoderImage SegmentationObjectSegmentationSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object SegmentationVideo Semantic SegmentationVisual Object TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Training-Free Robust Interactive Video Object Segmentation
Interactive video object segmentation is a crucial video task, having various applications from video editing to data annotating. However, current approaches struggle to accurately segment objects across diverse domains.…
Interactive Video Object SegmentationObjectPoint TrackingSegmentation+5Temporal-Conditional Referring Video Object Segmentation with Noise-Free Text-to-Video Diffusion Model
Referring Video Object Segmentation (RVOS) aims to segment specific objects in a video according to textual descriptions. We observe that recent RVOS approaches often place excessive emphasis on feature extraction and te…
Referring Video Object SegmentationObjectMix: Data Augmentation by Copy-Pasting Objects in Videos for Action Recognition
In this paper, we propose a data augmentation method for action recognition using instance segmentation. Although many data augmentation methods have been proposed for image recognition, few of them are tailored for acti…
Action RecognitionData AugmentationInstance SegmentationSegmentation+1Efficient Track Anything
Segment Anything Model 2 (SAM 2) has emerged as a powerful tool for video object segmentation and tracking anything. Key components of SAM 2 that drive the impressive video object segmentation performance include a large…
ObjectSegmentationSemantic SegmentationVideo Object Segmentation+2Co-segmentation Inspired Attention Module for Video-based Computer Vision Tasks
Video-based computer vision tasks can benefit from estimation of the salient regions and interactions between those regions. Traditionally, this has been done by identifying the object regions in the images by utilizing …
Action ClassificationObjectobject-detectionObject Detection+4