Detecting Reflections by Combining Semantic and Instance Segmentation
Reflections in natural images commonly cause false positives in automated detection systems. These false positives can lead to significant impairment of accuracy in the tasks of detection, counting and segmentation. Here, inspired by the recent panoptic approach to segmentation, we show how fusing instance and semantic segmentation can automatically identify reflection false positives, without explicitly needing to have the reflective regions labelled. We explore in detail how state of the art two-stage detectors suffer a loss of broader contextual features, and hence are unable to learn to ignore these reflections. We then present an approach to fuse instance and semantic segmentations for this application, and subsequently show how this reduces false positive detections in a real world surveillance data with a large number of reflective surfaces. This demonstrates how panoptic segmentation and related work, despite being in its infancy, can already be useful in real world computer vision problems.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
RaidaR: A Rich Annotated Image Dataset of Rainy Street Scenes
We introduce RaidaR, a rich annotated image dataset of rainy street scenes, to support autonomous driving research. The new dataset contains the largest number of rainy images (58,542) to date, 5,000 of which provide sem…
Autonomous DrivingData AugmentationImage-to-Image TranslationRain Removal+2DetectFusion: Detecting and Segmenting Both Known and Unknown Dynamic Objects in Real-time SLAM
We present DetectFusion, an RGB-D SLAM system that runs in real-time and can robustly handle semantically known and unknown objects that can move dynamically in the scene. Our system detects, segments and assigns semanti…
2D Object DetectionInstance Segmentationobject-detectionObject Detection+3blob loss: instance imbalance aware loss functions for semantic segmentation
Deep convolutional neural networks (CNN) have proven to be remarkably effective in semantic segmentation tasks. Most popular loss functions were introduced targeting improved volumetric scores, such as the Dice coefficie…
3D Semantic SegmentationSegmentationSemantic SegmentationLearning Panoptic Segmentation from Instance Contours
Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and in…
ClusteringInstance SegmentationPanoptic SegmentationScene Understanding+2MaskLab: Instance Segmentation by Refining Object Detection with Semantic and Direction Features
In this work, we tackle the problem of instance segmentation, the task of simultaneously solving object detection and semantic segmentation. Towards this goal, we present a model, called MaskLab, which produces three out…
Instance SegmentationObjectobject-detectionObject Detection+3