Ensembling Instance and Semantic Segmentation for Panoptic Segmentation

2023-04-20 · Mehmet Yildirim, Yogesh Langhe

We demonstrate our solution for the 2019 COCO panoptic segmentation task. Our method first performs instance segmentation and semantic segmentation separately, then combines the two to generate panoptic segmentation results. To enhance the performance, we add several expert models of Mask R-CNN in instance segmentation to tackle the data imbalance problem in the training data; also HTC model is adopted yielding our best instance segmentation results. In semantic segmentation, we trained several models with various backbones and use an ensemble strategy which further boosts the segmentation results. In the end, we analyze various combinations of instance and semantic segmentation, and report on their performance for the final panoptic segmentation results. Our best model achieves $PQ$ 47.1 on 2019 COCO panoptic test-dev data.

📄 PDF Abstract BibTeX arXiv:2304.10326

Code (0)

등록된 구현이 없습니다.

Tasks

Instance Segmentation Panoptic Segmentation Segmentation Semantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

FPN 설명 없음

Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…

HTC 설명 없음

Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation

2021-03-27 · CVPR 2021 1 · Zixiang Zhou, Yang Zhang, Hassan Foroosh

Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an effi…

Clustering Instance Segmentation Panoptic Segmentation Segmentation+1

Learning Panoptic Segmentation from Instance Contours

2020-10-16 · Sumanth Chennupati, Venkatraman Narayanan, Ganesh Sistu, Senthil Yogamani 외

Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and in…

Clustering Instance Segmentation Panoptic Segmentation Scene Understanding+2

3D Open-Vocabulary Panoptic Segmentation with 2D-3D Vision-Language Distillation

2024-01-04 · Zihao Xiao, Longlong Jing, Shangxuan Wu, Alex Zihao Zhu 외

3D panoptic segmentation is a challenging perception task, especially in autonomous driving. It aims to predict both semantic and instance annotations for 3D points in a scene. Although prior 3D panoptic segmentation app…

3D Panoptic Segmentation Autonomous Driving Classification Open Vocabulary Panoptic Segmentation+2

Panoptic-DeepLab

2019-10-10 · Bowen Cheng, Maxwell D. Collins, Yukun Zhu, Ting Liu 외

We present Panoptic-DeepLab, a bottom-up and single-shot approach for panoptic segmentation. Our Panoptic-DeepLab is conceptually simple and delivers state-of-the-art results. In particular, we adopt the dual-ASPP and du…

Decoder Instance Segmentation Panoptic Segmentation regression+2

BANet: Bidirectional Aggregation Network with Occlusion Handling for Panoptic Segmentation

2020-03-31 · CVPR 2020 6 · Yifeng Chen, Guangchen Lin, Songyuan Li, Bourahla Omar 외

Panoptic segmentation aims to perform instance segmentation for foreground instances and semantic segmentation for background stuff simultaneously. The typical top-down pipeline concentrates on two key issues: 1) how to …

Instance Segmentation Occlusion Handling Panoptic Segmentation Segmentation+1