paper-with-me

Papers

PanDepth: Joint Panoptic Segmentation and Depth Completion

2022-12-29 · Juan Lagos, Esa Rahtu

Understanding 3D environments semantically is pivotal in autonomous driving applications where multiple computer vision tasks are involved. Multi-task models provide different types of outputs for a given scene, yielding a more holistic representation while keeping the computational cost low. We propose a multi-task model for panoptic segmentation and depth completion using RGB images and sparse depth maps. Our model successfully predicts fully dense depth maps and performs semantic segmentation, instance segmentation, and panoptic segmentation for every input frame. Extensive experiments were done on the Virtual KITTI 2 dataset and we demonstrate that our model solves multiple tasks, without a significant increase in computational cost, while keeping high accuracy performance. Code is available at https://github.com/juanb09111/PanDepth.git

📄 PDF Abstract BibTeX arXiv:2212.14180

Code (1)

juanb09111/pandepth 공식 구현 pytorch

Tasks

Autonomous DrivingDepth CompletionInstance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Towards Deeply Unified Depth-aware Panoptic Segmentation with Bi-directional Guidance Learning

2023-07-27 · ICCV 2023 1 · Junwen He, Yifan Wang, Lijun Wang, Huchuan Lu 외

Depth-aware panoptic segmentation is an emerging topic in computer vision which combines semantic and geometric understanding for more robust scene interpretation. Recent works pursue unified frameworks to tackle this ch…

Depth EstimationPanoptic SegmentationSegmentation

ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentation

2020-12-09 · CVPR 2021 1 · Siyuan Qiao, Yukun Zhu, Hartwig Adam, Alan Yuille 외

In this paper, we present ViP-DeepLab, a unified model attempting to tackle the long-standing and challenging inverse projection problem in vision, which we model as restoring the point clouds from perspective image sequ…

Depth-aware Video Panoptic SegmentationDepth EstimationMonocular Depth EstimationPanoptic Segmentation+2

Uni-DVPS: Unified Model for Depth-Aware Video Panoptic Segmentation

2024-07-01 · IEEE Robotics and Automation Letters (RA-L) 2024 7 · Kim Ji-Yeon, Oh Hyun-Bin, Kwon Byung-Ki, Dahun Kim 외

We present Uni-DVPS, a unified model for Depth-aware Video Panoptic Segmentation (DVPS) that jointly tackles distinct vision tasks, i.e., video panoptic segmentation, monocular depth estimation, and object tracking. In c…

Autonomous DrivingDecoderDepth-aware Video Panoptic SegmentationDepth Estimation+7

Joint Forecasting of Panoptic Segmentations with Difference Attention

2022-04-14 · CVPR 2022 1 · Colin Graber, Cyril Jazra, Wenjie Luo, LiangYan Gui 외

Forecasting of a representation is important for safe and effective autonomy. For this, panoptic segmentations have been studied as a compelling representation in recent work. However, recent state-of-the-art on panoptic…

ObjectPanoptic SegmentationSegmentation

MonoDVPS: A Self-Supervised Monocular Depth Estimation Approach to Depth-aware Video Panoptic Segmentation

2022-10-14 · Andra Petrovai, Sergiu Nedevschi

Depth-aware video panoptic segmentation tackles the inverse projection problem of restoring panoptic 3D point clouds from video sequences, where the 3D points are augmented with semantic classes and temporally consistent…

Depth-aware Video Panoptic SegmentationDepth EstimationDepth PredictionImage Segmentation+5