BlendMask: Top-Down Meets Bottom-Up for Instance Segmentation
Instance segmentation is one of the fundamental vision tasks. Recently, fully convolutional instance segmentation methods have drawn much attention as they are often simpler and more efficient than two-stage approaches like Mask R-CNN. To date, almost all such approaches fall behind the two-stage Mask R-CNN method in mask precision when models have similar computation complexity, leaving great room for improvement. In this work, we achieve improved mask prediction by effectively combining instance-level information with semantic information with lower-level fine-granularity. Our main contribution is a blender module which draws inspiration from both top-down and bottom-up instance segmentation approaches. The proposed BlendMask can effectively predict dense per-pixel position-sensitive instance features with very few channels, and learn attention maps for each instance with merely one convolution layer, thus being fast in inference. BlendMask can be easily incorporated with the state-of-the-art one-stage detection frameworks and outperforms Mask R-CNN under the same training schedule while being 20% faster. A light-weight version of BlendMask achieves $ 34.2% $ mAP at 25 FPS evaluated on a single 1080Ti GPU card. Because of its simplicity and efficacy, we hope that our BlendMask could serve as a simple yet strong baseline for a wide range of instance-wise prediction tasks. Code is available at https://git.io/AdelaiDet
Code (9)
Tasks
GPUInstance SegmentationReal-time Instance SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Open-world Instance Segmentation: Top-down Learning with Bottom-up Supervision
Many top-down architectures for instance segmentation achieve significant success when trained and tested on pre-defined closed-world taxonomy. However, when deployed in the open world, they exhibit notable bias towards …
Instance SegmentationOpen-World Instance SegmentationSegmentationSemantic SegmentationTop-Down Beats Bottom-Up in 3D Instance Segmentation
Most 3D instance segmentation methods exploit a bottom-up strategy, typically including resource-exhaustive post-processing. For point grouping, bottom-up methods rely on prior assumptions about the objects in the form o…
3D Instance SegmentationInstance SegmentationSegmentationSemantic SegmentationZigZagNet: Fusing Top-Down and Bottom-Up Context for Object Segmentation
Multi-scale context information has proven to be essential for object segmentation tasks. Recent works construct the multi-scale context by aggregating convolutional feature maps extracted by different levels of a deep n…
Instance SegmentationSegmentationSemantic SegmentationParallel Detection-and-Segmentation Learning for Weakly Supervised Instance Segmentation
Weakly supervised instance segmentation (WSIS) with only image-level labels has recently drawn much attention. To date, bottom-up WSIS methods refine discriminative cues from classifiers with sophisticated multi-stag…
Instance Segmentationobject-detectionObject DetectionSegmentation+4Unifying Instance and Panoptic Segmentation with Dynamic Rank-1 Convolutions
Recently, fully-convolutional one-stage networks have shown superior performance comparing to two-stage frameworks for instance segmentation as typically they can generate higher-quality mask predictions with less comput…
Instance SegmentationMulti-Task LearningPanoptic SegmentationSegmentation+1