REFINE: Prediction Fusion Network for Panoptic Segmentation
Panoptic segmentation aims at generating pixel-wise class and instance predictions for each pixel in the input image, which is a challenging task and far more complicated than naively fusing the semantic and instance segmentation results. Prediction fusion is therefore important to achieve accurate panoptic segmentation. In this paper, we present REFINE, pREdiction FusIon NEtwork for panoptic segmentation, to achieve high-quality panoptic segmentation by improving cross-task prediction fusion, and within-task prediction fusion. Our single-model ResNeXt-101 with DCN achieves PQ=51.5 on the COCO dataset, surpassing state-of-the-art performance by a convincing margin and is comparable with ensembled models. Our smaller model with a ResNet-50 backbone achieves PQ=44.9, which is comparable with state-of-the-art methods with larger backbones.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationPanoptic SegmentationPredictionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Multi-task Fusion for Efficient Panoptic-Part Segmentation
In this paper, we introduce a novel network that generates semantic, instance, and part segmentation using a shared encoder and effectively fuses them to achieve panoptic-part segmentation. Unifying these three segmentat…
Image SegmentationPart-aware Panoptic SegmentationRepresentation LearningSegmentationRobust Vision Challenge 2020 -- 1st Place Report for Panoptic Segmentation
In this technical report, we present key details of our winning panoptic segmentation architecture EffPS_b1bs4_RVC. Our network is a lightweight version of our state-of-the-art EfficientPS architecture that consists of o…
BenchmarkingPanoptic SegmentationSegmentationSemantic SegmentationDynamic Prompting of Frozen Text-to-Image Diffusion Models for Panoptic Narrative Grounding
Panoptic narrative grounding (PNG), whose core target is fine-grained image-text alignment, requires a panoptic segmentation of referred objects given a narrative caption. Previous discriminative methods achieve only wea…
Panoptic SegmentationSegmentationMambaPanoptic: A Vision Mamba-based Structured State Space Framework for Panoptic Segmentation
Panoptic segmentation requires the simultaneous recognition of countable thing instances and amorphous stuff regions, placing joint demands on long-range context modelling, multi-scale feature representation, and efficie…
Panoptic SegmentationJoint Forecasting of Panoptic Segmentations with Difference Attention
Forecasting of a representation is important for safe and effective autonomy. For this, panoptic segmentations have been studied as a compelling representation in recent work. However, recent state-of-the-art on panoptic…
ObjectPanoptic SegmentationSegmentation