False Negative Reduction in Video Instance Segmentation using Uncertainty Estimates
Instance segmentation of images is an important tool for automated scene understanding. Neural networks are usually trained to optimize their overall performance in terms of accuracy. Meanwhile, in applications such as automated driving, an overlooked pedestrian seems more harmful than a falsely detected one. In this work, we present a false negative detection method for image sequences based on inconsistencies in time series of tracked instances given the availability of image sequences in online applications. As the number of instances can be greatly increased by this algorithm, we apply a false positive pruning using uncertainty estimates aggregated over instances. To this end, instance-wise metrics are constructed which characterize uncertainty and geometry of a given instance or are predicated on depth estimation. The proposed method serves as a post-processing step applicable to any neural network that can also be trained on single frames only. In our tests, we obtain an improved trade-off between false negative and false positive instances by our fused detection approach in comparison to the use of an ordinary score value provided by the instance segmentation network during inference.
Code (1)
Tasks
Depth EstimationInstance SegmentationScene UnderstandingSemantic SegmentationTime SeriesTime Series AnalysisVideo Instance SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MetaFusion: Controlled False-Negative Reduction of Minority Classes in Semantic Segmentation
In semantic segmentation datasets, classes of high importance are oftentimes underrepresented, e.g., humans in street scenes. Neural networks are usually trained to reduce the overall number of errors, attaching identica…
Semantic SegmentationUnsupervised Video Object Segmentation with Distractor-Aware Online Adaptation
Unsupervised video object segmentation is a crucial application in video analysis without knowing any prior information about the objects. It becomes tremendously challenging when multiple objects occur and interact in a…
Instance SegmentationObjectSegmentationSemantic Segmentation+3High-Quality Unknown Object Instance Segmentation via Quadruple Boundary Error Refinement
Accurate and efficient segmentation of unknown objects in unstructured environments is essential for robotic manipulation. Unknown Object Instance Segmentation (UOIS), which aims to identify all objects in unknown catego…
Instance SegmentationObjectSegmentationSemantic Segmentation+1Spherical Mask: Coarse-to-Fine 3D Point Cloud Instance Segmentation with Spherical Representation
Coarse-to-fine 3D instance segmentation methods show weak performances compared to recent Grouping-based, Kernel-based and Transformer-based methods. We argue that this is due to two limitations: 1) Instance size overest…
3D Instance SegmentationInstance SegmentationSemantic SegmentationFalse Negative Reduction in Semantic Segmentation under Domain Shift using Depth Estimation
State-of-the-art deep neural networks demonstrate outstanding performance in semantic segmentation. However, their performance is tied to the domain represented by the training data. Open world scenarios cause inaccurate…
Depth EstimationMonocular Depth EstimationSegmentationSemantic Segmentation