Improving Panoptic Segmentation at All Scales
Crop-based training strategies decouple training resolution from GPU memory consumption, allowing the use of large-capacity panoptic segmentation networks on multi-megapixel images. Using crops, however, can introduce a bias towards truncating or missing large objects. To address this, we propose a novel crop-aware bounding box regression loss (CABB loss), which promotes predictions to be consistent with the visible parts of the cropped objects, while not over-penalizing them for extending outside of the crop. We further introduce a novel data sampling and augmentation strategy which improves generalization across scales by counteracting the imbalanced distribution of object sizes. Combining these two contributions with a carefully designed, top-down panoptic segmentation architecture, we obtain new state-of-the-art results on the challenging Mapillary Vistas (MVD), Indian Driving and Cityscapes datasets, surpassing the previously best approach on MVD by +4.5% PQ and +5.2% mAP.
Code (0)
등록된 구현이 없습니다.
Tasks
AllGPUPanoptic SegmentationSegmentationSimilar Papers 제목 키워드 기반
Large-Scale Video Panoptic Segmentation in the Wild: A Benchmark
In this paper, we present a new large-scale dataset for the video panoptic segmentation task, which aims to assign semantic classes and track identities to all pixels in a video. As the ground truth for this task is …
Panoptic SegmentationSegmentationVideo Panoptic SegmentationPanDA: Panoptic Data Augmentation
The recently proposed panoptic segmentation task presents a significant challenge of image understanding with computer vision by unifying semantic segmentation and instance segmentation tasks. In this paper we present an…
Data AugmentationInstance SegmentationPanoptic SegmentationSegmentation+1Robust Vision Challenge 2020 -- 1st Place Report for Panoptic Segmentation
In this technical report, we present key details of our winning panoptic segmentation architecture EffPS_b1bs4_RVC. Our network is a lightweight version of our state-of-the-art EfficientPS architecture that consists of o…
BenchmarkingPanoptic SegmentationSegmentationSemantic SegmentationIn-Place Panoptic Radiance Field Segmentation with Perceptual Prior for 3D Scene Understanding
Accurate 3D scene representation and panoptic understanding are essential for applications such as virtual reality, robotics, and autonomous driving. However, challenges persist with existing methods, including precise 2…
2D Panoptic SegmentationAutonomous DrivingPanoptic SegmentationScene UnderstandingDaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Model
Observing the close relationship among panoptic, semantic and instance segmentation tasks, we propose to train a universal multi-dataset multi-task segmentation model: DaTaSeg.We use a shared representation (mask proposa…
Instance SegmentationSegmentationSemantic SegmentationTransfer Learning