Deep Learning Techniques for Video Instance Segmentation: A Survey
Video instance segmentation, also known as multi-object tracking and segmentation, is an emerging computer vision research area introduced in 2019, aiming at detecting, segmenting, and tracking instances in videos simultaneously. By tackling the video instance segmentation tasks through effective analysis and utilization of visual information in videos, a range of computer vision-enabled applications (e.g., human action recognition, medical image processing, autonomous vehicle navigation, surveillance, etc) can be implemented. As deep-learning techniques take a dominant role in various computer vision areas, a plethora of deep-learning-based video instance segmentation schemes have been proposed. This survey offers a multifaceted view of deep-learning schemes for video instance segmentation, covering various architectural paradigms, along with comparisons of functional performance, model complexity, and computational overheads. In addition to the common architectural designs, auxiliary techniques for improving the performance of deep-learning models for video instance segmentation are compiled and discussed. Finally, we discuss a range of major challenges and directions for further investigations to help advance this promising research field.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionDeep LearningInstance SegmentationMulti-Object TrackingMulti-Object Tracking and SegmentationObject TrackingSegmentationSemantic SegmentationSurveyTemporal Action LocalizationVideo Instance SegmentationSimilar Papers 제목 키워드 기반
A Comprehensive Survey on Video Scene Parsing:Advances, Challenges, and Prospects
Video Scene Parsing (VSP) has emerged as a cornerstone in computer vision, facilitating the simultaneous segmentation, recognition, and tracking of diverse visual entities in dynamic scenes. In this survey, we present a …
BenchmarkingInstance SegmentationOpen-Vocabulary Video SegmentationPanoptic Segmentation+8Temporal Action Segmentation: An Analysis of Modern Techniques
Temporal action segmentation (TAS) in videos aims at densely identifying video frames in minutes-long videos with multiple action classes. As a long-range video understanding task, researchers have developed an extended …
Action SegmentationSegmentationSurveyTemporal Action Segmentation+1A Survey on Instance Segmentation: State of the art
Object detection or localization is an incremental step in progression from coarse to fine digital image inference. It not only provides the classes of the image objects, but also provides the location of the image objec…
Instance SegmentationObjectobject-detectionObject Detection+3Foundation Models for Amodal Video Instance Segmentation in Automated Driving
In this work, we study amodal video instance segmentation for automated driving. Previous works perform amodal video instance segmentation relying on methods trained on entirely labeled video data with techniques borrowe…
Amodal Instance SegmentationInstance SegmentationPoint TrackingSegmentation+2PM-VIS+: High-Performance Video Instance Segmentation without Video Annotation
Video instance segmentation requires detecting, segmenting, and tracking objects in videos, typically relying on costly video annotations. This paper introduces a method that eliminates video annotations by utilizing ima…
Instance SegmentationSegmentationSemantic SegmentationVideo Instance Segmentation