paper-with-me

홈 › Papers

EfficientPS: Efficient Panoptic Segmentation

2020-04-05 · Rohit Mohan, Abhinav Valada

Understanding the scene in which an autonomous robot operates is critical for its competent functioning. Such scene comprehension necessitates recognizing instances of traffic participants along with general scene semantics which can be effectively addressed by the panoptic segmentation task. In this paper, we introduce the Efficient Panoptic Segmentation (EfficientPS) architecture that consists of a shared backbone which efficiently encodes and fuses semantically rich multi-scale features. We incorporate a new semantic head that aggregates fine and contextual features coherently and a new variant of Mask R-CNN as the instance head. We also propose a novel panoptic fusion module that congruously integrates the output logits from both the heads of our EfficientPS architecture to yield the final panoptic segmentation output. Additionally, we introduce the KITTI panoptic segmentation dataset that contains panoptic annotations for the popularly challenging KITTI benchmark. Extensive evaluations on Cityscapes, KITTI, Mapillary Vistas and Indian Driving Dataset demonstrate that our proposed architecture consistently sets the new state-of-the-art on all these four benchmarks while being the most efficient and fast panoptic segmentation architecture to date.

📄 PDF Abstract BibTeX arXiv:2004.02307

Code (2)

DeepSceneSeg/EfficientPS 공식 구현 pytorch
vincrichard/EfficientPS pytorch

Tasks

Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Robust Vision Challenge 2020 -- 1st Place Report for Panoptic Segmentation

2020-08-23 · Rohit Mohan, Abhinav Valada

In this technical report, we present key details of our winning panoptic segmentation architecture EffPS_b1bs4_RVC. Our network is a lightweight version of our state-of-the-art EfficientPS architecture that consists of o…

BenchmarkingPanoptic SegmentationSegmentationSemantic Segmentation

MOPT: Multi-Object Panoptic Tracking

2020-04-17 · Juana Valeria Hurtado, Rohit Mohan, Wolfram Burgard, Abhinav Valada

Comprehensive understanding of dynamic scenes is a critical prerequisite for intelligent robots to autonomously operate in their environment. Research in this domain, which encompasses diverse perception problems, has pr…

Instance SegmentationMulti-Object TrackingObjectObject Tracking+4

PVO: Panoptic Visual Odometry

2022-07-04 · CVPR 2023 1 · Weicai Ye, Xinyue Lan, Shuo Chen, Yuhang Ming 외

We present PVO, a novel panoptic visual odometry framework to achieve more comprehensive modeling of the scene motion, geometry, and panoptic segmentation information. Our PVO models visual odometry (VO) and video panopt…

Camera Pose EstimationOptical Flow EstimationPanoptic SegmentationPose Estimation+3

Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation

2021-03-27 · CVPR 2021 1 · Zixiang Zhou, Yang Zhang, Hassan Foroosh

Panoptic segmentation presents a new challenge in exploiting the merits of both detection and segmentation, with the aim of unifying instance segmentation and semantic segmentation in a single framework. However, an effi…

ClusteringInstance SegmentationPanoptic SegmentationSegmentation+1

Single-shot Path Integrated Panoptic Segmentation

2020-12-03 · Sukjun Hwang, Seoung Wug Oh, Seon Joo Kim

Panoptic segmentation, which is a novel task of unifying instance segmentation and semantic segmentation, has attracted a lot of attention lately. However, most of the previous methods are composed of multiple pathways w…

Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation