Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Data
Knowing when a trained segmentation model is encountering data that is different to its training data is important. Understanding and mitigating the effects of this play an important part in their application from a performance and assurance perspective - this being a safety concern in applications such as autonomous vehicles (AVs). This work presents a segmentation network that can detect errors caused by challenging test domains without any additional annotation in a single forward pass. As annotation costs limit the diversity of labelled datasets, we use easy-to-obtain, uncurated and unlabelled data to learn to perform uncertainty estimation by selectively enforcing consistency over data augmentation. To this end, a novel segmentation benchmark based on the SAX Dataset is used, which includes labelled test data spanning three autonomous-driving domains, ranging in appearance from dense urban to off-road. The proposed method, named Gamma-SSL, consistently outperforms uncertainty estimation and Out-of-Distribution (OoD) techniques on this difficult benchmark - by up to 10.7% in area under the receiver operating characteristic (ROC) curve and 19.2% in area under the precision-recall (PR) curve in the most challenging of the three scenarios.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingAutonomous VehiclesData AugmentationDiversitySegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
On the Practicality of Deterministic Epistemic Uncertainty
A set of novel approaches for estimating epistemic uncertainty in deep neural networks with a single forward pass has recently emerged as a valid alternative to Bayesian Neural Networks. On the premise of informative rep…
Image ClassificationOut of Distribution (OOD) DetectionSemantic SegmentationvalidCloser Look at the Uncertainty Estimation in Semantic Segmentation under Distributional Shift
While recent computer vision algorithms achieve impressive performance on many benchmarks, they lack robustness - presented with an image from a different distribution, (e.g. weather or lighting conditions not considered…
Data AugmentationSemantic SegmentationStyle TransferEvaluating Predictive Uncertainty under Distributional Shift on Dialogue Dataset
In open-domain dialogues, predictive uncertainties are mainly evaluated in a domain shift setting to cope with out-of-distribution inputs. However, in real-world conversations, there could be more extensive distributiona…
Shifts 2.0: Extending The Dataset of Real Distributional Shifts
Distributional shift, or the mismatch between training and deployment data, is a significant obstacle to the usage of machine learning in high-stakes industrial applications, such as autonomous driving and medicine. This…
Autonomous Drivingimage-classificationImage ClassificationMachine Translation+2Learning to Navigate Under Imperfect Perception: Conformalised Segmentation for Safe Reinforcement Learning
Reliable navigation in safety-critical environments requires both accurate hazard perception and principled uncertainty handling to strengthen downstream safety handling. Despite the effectiveness of existing approaches,…
Reinforcement LearningSemantic Segmentation