Uncertainty estimation in Deep Learning for Panoptic segmentation

2023-04-04 · Michael Smith, Frank Ferrie

As deep learning-based computer vision algorithms continue to advance the state of the art, their robustness to real-world data continues to be an issue, making it difficult to bring an algorithm from the lab to the real world. Ensemble-based uncertainty estimation approaches such as Monte Carlo Dropout have been successfully used in many applications in an attempt to address this robustness issue. Unfortunately, it is not always clear if such ensemble-based approaches can be applied to a new problem domain. This is the case with panoptic segmentation, where the structure of the problem and architectures designed to solve it means that unlike image classification or even semantic segmentation, the typical solution of using a mean across samples cannot be directly applied. In this paper, we demonstrate how ensemble-based uncertainty estimation approaches such as Monte Carlo Dropout can be used in the panoptic segmentation domain with no changes to an existing network, providing both improved performance and more importantly a better measure of uncertainty for predictions made by the network. Results are demonstrated quantitatively and qualitatively on the COCO, KITTI-STEP and VIPER datasets.

📄 PDF Abstract BibTeX arXiv:2304.02098

Code (0)

등록된 구현이 없습니다.

Tasks

Deep Learningimage-classification Image Classification Panoptic Segmentation Segmentation Semantic Segmentation

Methods 이 논문이 사용한 방법론

Monte Carlo Dropout 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Uncertainty-aware Panoptic Segmentation

2022-06-29 · Kshitij Sirohi, Sajad Marvi, Daniel Büscher, Wolfram Burgard

Reliable scene understanding is indispensable for modern autonomous systems. Current learning-based methods typically try to maximize their performance based on segmentation metrics that only consider the quality of the …

Panoptic Segmentation Scene Understanding Segmentation Uncertainty-Aware Panoptic Segmentation

Uncertainty-aware LiDAR Panoptic Segmentation

2022-10-10 · Kshitij Sirohi, Sajad Marvi, Daniel Büscher, Wolfram Burgard

Modern autonomous systems often rely on LiDAR scanners, in particular for autonomous driving scenarios. In this context, reliable scene understanding is indispensable. Current learning-based methods typically try to achi…

Autonomous Driving Panoptic Segmentation Scene Understanding Segmentation+1

ProPanDL: A Modular Architecture for Uncertainty-Aware Panoptic Segmentation

2023-04-17 · Jacob Deery, Chang Won Lee, Steven Waslander

We introduce ProPanDL, a family of networks capable of uncertainty-aware panoptic segmentation. Unlike existing segmentation methods, ProPanDL is capable of estimating full probability distributions for both the semantic…

Panoptic Segmentation scoring rule Segmentation Uncertainty-Aware Panoptic Segmentation

Open-Set LiDAR Panoptic Segmentation Guided by Uncertainty-Aware Learning

2025-06-16 · Rohit Mohan, Julia Hindel, Florian Drews, Claudius Gläser 외

Autonomous vehicles that navigate in open-world environments may encounter previously unseen object classes. However, most existing LiDAR panoptic segmentation models rely on closed-set assumptions, failing to detect unk…

Autonomous Vehicles Navigate Panoptic Segmentation Segmentation+1

U-SEG: Uncertainty in SEGmentation -- A systematic multi-variable exploration

2026-05-14 · Michael Smith, Frank P. Ferrie arxiv

In this study, we explore in depth a few under-studied topics at the intersection of uncertainty estimation and segmentation. Prior work has shown that the quality of uncertainty estimates can be very sensitive to a rang…

Panoptic Segmentation