Simultaneous Detection and Segmentation
We aim to detect all instances of a category in an image and, for each instance, mark the pixels that belong to it. We call this task Simultaneous Detection and Segmentation (SDS). Unlike classical bounding box detection, SDS requires a segmentation and not just a box. Unlike classical semantic segmentation, we require individual object instances. We build on recent work that uses convolutional neural networks to classify category-independent region proposals (R-CNN [16]), introducing a novel architecture tailored for SDS. We then use category-specific, top- down figure-ground predictions to refine our bottom-up proposals. We show a 7 point boost (16% relative) over our baselines on SDS, a 5 point boost (10% relative) over state-of-the-art on semantic segmentation, and state-of-the-art performance in object detection. Finally, we provide diagnostic tools that unpack performance and provide directions for future work.
Code (0)
등록된 구현이 없습니다.
Tasks
Diagnosticobject-detectionObject DetectionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
UOLO - automatic object detection and segmentation in biomedical images
We propose UOLO, a novel framework for the simultaneous detection and segmentation of structures of interest in medical images. UOLO consists of an object segmentation module which intermediate abstract representations a…
Fovea DetectionMedical Image Segmentationobject-detectionObject Detection+2Fully automatic computer-aided mass detection and segmentation via pseudo-color mammograms and Mask R-CNN
Mammographic mass detection and segmentation are usually performed as serial and separate tasks, with segmentation often only performed on manually confirmed true positive detections in previous studies. We propose a ful…
Image GenerationSegmentationTransfer LearningIlluminating Pedestrians via Simultaneous Detection & Segmentation
Pedestrian detection is a critical problem in computer vision with significant impact on safety in urban autonomous driving. In this work, we explore how semantic segmentation can be used to boost pedestrian detection ac…
Autonomous DrivingPedestrian DetectionSegmentationSemantic SegmentationSimultaneous Object Detection and Semantic Segmentation
Both object detection in and semantic segmentation of camera images are important tasks for automated vehicles. Object detection is necessary so that the planning and behavior modules can reason about other road users. S…
Objectobject-detectionObject DetectionSegmentation+1Multi-Scale Patch Aggregation (MPA) for Simultaneous Detection and Segmentation
Aiming at simultaneous detection and segmentation (SDS), we propose a proposal-free framework, which detect and segment object instances via mid-level patches. We design a unified trainable network on patches, which is f…
ObjectObject Proposal GenerationSegmentation