paper-with-me

홈 › Papers

DUDES: Deep Uncertainty Distillation using Ensembles for Semantic Segmentation

2023-03-17 · Steven Landgraf, Kira Wursthorn, Markus Hillemann, Markus Ulrich

Deep neural networks lack interpretability and tend to be overconfident, which poses a serious problem in safety-critical applications like autonomous driving, medical imaging, or machine vision tasks with high demands on reliability. Quantifying the predictive uncertainty is a promising endeavour to open up the use of deep neural networks for such applications. Unfortunately, current available methods are computationally expensive. In this work, we present a novel approach for efficient and reliable uncertainty estimation which we call Deep Uncertainty Distillation using Ensembles for Segmentation (DUDES). DUDES applies student-teacher distillation with a Deep Ensemble to accurately approximate predictive uncertainties with a single forward pass while maintaining simplicity and adaptability. Experimentally, DUDES accurately captures predictive uncertainties without sacrificing performance on the segmentation task and indicates impressive capabilities of identifying wrongly classified pixels and out-of-domain samples on the Cityscapes dataset. With DUDES, we manage to simultaneously simplify and outperform previous work on Deep Ensemble-based Uncertainty Distillation.

📄 PDF Abstract BibTeX arXiv:2303.09843

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Uncertainty-Aware Retinal Vessel Segmentation via Ensemble Distillation

2025-09-15 · Jeremiah Fadugba, Petru Manescu, Bolanle Oladejo, Delmiro Fernandez-Reyes 외 arxiv

Uncertainty estimation is critical for reliable medical image segmentation, particularly in retinal vessel analysis, where accurate predictions are essential for diagnostic applications. Deep Ensembles, where multiple ne…

Retinal Vessel SegmentationMedical Image Segmentation

A Comparative Study on Multi-task Uncertainty Quantification in Semantic Segmentation and Monocular Depth Estimation

2024-05-27 · Steven Landgraf, Markus Hillemann, Theodor Kapler, Markus Ulrich

Deep neural networks excel in perception tasks such as semantic segmentation and monocular depth estimation, making them indispensable in safety-critical applications like autonomous driving and industrial inspection. Ho…

Autonomous DrivingDepth EstimationMonocular Depth EstimationMulti-Task Learning+2

Evaluating Uncertainty Estimation Methods on 3D Semantic Segmentation of Point Clouds

2020-07-03 · Swaroop Bhandary K, Nico Hochgeschwender, Paul Plöger, Frank Kirchner 외

Deep learning models are extensively used in various safety critical applications. Hence these models along with being accurate need to be highly reliable. One way of achieving this is by quantifying uncertainty. Bayesia…

3D Semantic SegmentationDecision MakingSemantic SegmentationUncertainty Quantification

A general framework for ensemble distribution distillation

2020-02-26 · Jakob Lindqvist, Amanda Olmin, Fredrik Lindsten, Lennart Svensson

Ensembles of neural networks have been shown to give better performance than single networks, both in terms of predictions and uncertainty estimation. Additionally, ensembles allow the uncertainty to be decomposed into a…

regression

Self-Distribution Distillation: Efficient Uncertainty Estimation

2022-03-15 · Yassir Fathullah, Mark J. F. Gales

Deep learning is increasingly being applied in safety-critical domains. For these scenarios it is important to know the level of uncertainty in a model's prediction to ensure appropriate decisions are made by the system.…

Out-of-Distribution Detection