Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks
We present Convolutional Oriented Boundaries (COB), which produces multiscale oriented contours and region hierarchies starting from generic image classification Convolutional Neural Networks (CNNs). COB is computationally efficient, because it requires a single CNN forward pass for multi-scale contour detection and it uses a novel sparse boundary representation for hierarchical segmentation; it gives a significant leap in performance over the state-of-the-art, and it generalizes very well to unseen categories and datasets. Particularly, we show that learning to estimate not only contour strength but also orientation provides more accurate results. We perform extensive experiments for low-level applications on BSDS, PASCAL Context, PASCAL Segmentation, and NYUD to evaluate boundary detection performance, showing that COB provides state-of-the-art contours and region hierarchies in all datasets. We also evaluate COB on high-level tasks when coupled with multiple pipelines for object proposals, semantic contours, semantic segmentation, and object detection on MS-COCO, SBD, and PASCAL; showing that COB also improves the results for all tasks.
Code (2)
Tasks
Boundary DetectionContour Detectionimage-classificationImage ClassificationImage Segmentationobject-detectionObject DetectionSegmentationSemantic SegmentationVocal Bursts Intensity PredictionSimilar Papers 제목 키워드 기반
Convolutional Oriented Boundaries
We present Convolutional Oriented Boundaries (COB), which produces multiscale oriented contours and region hierarchies starting from generic image classification Convolutional Neural Networks (CNNs). COB is computational…
Contour DetectionGeneral Classificationimage-classificationImage Classification+1A Pyramid CNN for Dense-Leaves Segmentation
Automatic detection and segmentation of overlapping leaves in dense foliage can be a difficult task, particularly for leaves with strong textures and high occlusions. We present Dense-Leaves, an image dataset with ground…
SegmentationOcclusion-Ordered Semantic Instance Segmentation
Standard semantic instance segmentation provides useful, but inherently 2D information from a single image. To enable 3D analysis, one usually integrates absolute monocular depth estimation with instance segmentation. Ho…
Depth EstimationInstance SegmentationMonocular Depth EstimationSegmentation+1SceneCut: Joint Geometric and Object Segmentation for Indoor Scenes
This paper presents SceneCut, a novel approach to jointly discover previously unseen objects and non-object surfaces using a single RGB-D image. SceneCut's joint reasoning over scene semantics and geometry allows a robot…
ObjectSemantic SegmentationOcclusion-Aware Instance Segmentation via BiLayer Network Architectures
Segmenting highly-overlapping image objects is challenging, because there is typically no distinction between real object contours and occlusion boundaries on images. Unlike previous instance segmentation methods, we mod…
Human Instance SegmentationInstance SegmentationSegmentationSemantic Segmentation+1