End-to-End Instance Segmentation with Recurrent Attention
While convolutional neural networks have gained impressive success recently in solving structured prediction problems such as semantic segmentation, it remains a challenge to differentiate individual object instances in the scene. Instance segmentation is very important in a variety of applications, such as autonomous driving, image captioning, and visual question answering. Techniques that combine large graphical models with low-level vision have been proposed to address this problem; however, we propose an end-to-end recurrent neural network (RNN) architecture with an attention mechanism to model a human-like counting process, and produce detailed instance segmentations. The network is jointly trained to sequentially produce regions of interest as well as a dominant object segmentation within each region. The proposed model achieves competitive results on the CVPPP, KITTI, and Cityscapes datasets.
Code (1)
Tasks
Autonomous DrivingImage CaptioningInstance SegmentationObjectQuestion AnsweringSegmentationSemantic SegmentationStructured PredictionVisual Question AnsweringVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
Consistent Video Instance Segmentation with Inter-Frame Recurrent Attention
Video instance segmentation aims at predicting object segmentation masks for each frame, as well as associating the instances across multiple frames. Recent end-to-end video instance segmentation methods are capable of p…
Instance SegmentationObjectSegmentationSemantic Segmentation+1Instance Segmentation and Tracking with Cosine Embeddings and Recurrent Hourglass Networks
Different to semantic segmentation, instance segmentation assigns unique labels to each individual instance of the same class. In this work, we propose a novel recurrent fully convolutional network architecture for track…
Instance SegmentationSegmentationSemantic SegmentationCCNet: Criss-Cross Attention for Semantic Segmentation
Contextual information is vital in visual understanding problems, such as semantic segmentation and object detection. We propose a Criss-Cross Network (CCNet) for obtaining full-image contextual information in a very eff…
Computational EfficiencyGPUHuman ParsingInstance Segmentation+7LIP: Learning Instance Propagation for Video Object Segmentation
In recent years, the task of segmenting foreground objects from background in a video, i.e. video object segmentation (VOS), has received considerable attention. In this paper, we propose a single end-to-end trainable de…
Data AugmentationInstance SegmentationObjectSegmentation+3PoSeg: Pose-Aware Refinement Network for Human Instance Segmentation
Human instance segmentation is a core problem for human-centric scene understanding and segmenting human instances poses a unique challenge to vision systems due to large intra-class variations in both appearance and sha…
Human Instance SegmentationInstance SegmentationPose EstimationScene Understanding+2