paper-with-me

홈 › Papers

Detecting and Learning the Unknown in Semantic Segmentation

2022-02-17 · Robin Chan, Svenja Uhlemeyer, Matthias Rottmann, Hanno Gottschalk

Semantic segmentation is a crucial component for perception in automated driving. Deep neural networks (DNNs) are commonly used for this task and they are usually trained on a closed set of object classes appearing in a closed operational domain. However, this is in contrast to the open world assumption in automated driving that DNNs are deployed to. Therefore, DNNs necessarily face data that they have never encountered previously, also known as anomalies, which are extremely safety-critical to properly cope with. In this work, we first give an overview about anomalies from an information-theoretic perspective. Next, we review research in detecting semantically unknown objects in semantic segmentation. We demonstrate that training for high entropy responses on anomalous objects outperforms other recent methods, which is in line with our theoretical findings. Moreover, we examine a method to assess the occurrence frequency of anomalies in order to select anomaly types to include into a model's set of semantic categories. We demonstrate that these anomalies can then be learned in an unsupervised fashion, which is particularly suitable in online applications based on deep learning.

📄 PDF Abstract BibTeX arXiv:2202.08700

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic Segmentation

Similar Papers 제목 키워드 기반

DetectFusion: Detecting and Segmenting Both Known and Unknown Dynamic Objects in Real-time SLAM

2019-07-22 · Ryo Hachiuma, Christian Pirchheim, Dieter Schmalstieg, Hideo Saito

We present DetectFusion, an RGB-D SLAM system that runs in real-time and can robustly handle semantically known and unknown objects that can move dynamically in the scene. Our system detects, segments and assigns semanti…

2D Object DetectionInstance Segmentationobject-detectionObject Detection+3

Dynamic semantic VSLAM with known and unknown objects

2024-12-18 · Sanghyoup Gu, Ratnesh Kumar

Traditional Visual Simultaneous Localization and Mapping (VSLAM) systems assume a static environment, which makes them ineffective in highly dynamic settings. To overcome this, many approaches integrate semantic informat…

Optical Flow EstimationSimultaneous Localization and Mapping

Detecting the Unexpected via Image Resynthesis

2019-04-16 · ICCV 2019 10 · Krzysztof Lis, Krishna Nakka, Pascal Fua, Mathieu Salzmann

Classical semantic segmentation methods, including the recent deep learning ones, assume that all classes observed at test time have been seen during training. In this paper, we tackle the more realistic scenario where u…

ResynthesisSemantic Segmentation

3D-AVS: LiDAR-based 3D Auto-Vocabulary Segmentation

2024-06-13 · CVPR 2025 1 · Weijie Wei, Osman Ülger, Fatemeh Karimi Nejadasl, Theo Gevers 외

Open-Vocabulary Segmentation (OVS) methods offer promising capabilities in detecting unseen object categories, but the category must be known and needs to be provided by a human, either via a text prompt or pre-labeled d…

Autonomous DrivingObjectSegmentationSemantic Similarity+1

Training-Free Out-Of-Distribution Segmentation With Foundation Models

2025-10-03 · Laith Nayal, Hadi Salloum, Ahmad Taha, Yaroslav Kholodov 외 arxiv

Detecting unknown objects in semantic segmentation is crucial for safety-critical applications such as autonomous driving. Large vision foundation models, including DINOv2, InternImage, and CLIP, have advanced visual rep…

Representation LearningSemantic SegmentationAutonomous Driving