Hybrid Open-set Segmentation with Synthetic Negative Data
Open-set segmentation can be conceived by complementing closed-set classification with anomaly detection. Many of the existing dense anomaly detectors operate through generative modelling of regular data or by discriminating with respect to negative data. These two approaches optimize different objectives and therefore exhibit different failure modes. Consequently, we propose a novel anomaly score that fuses generative and discriminative cues. Our score can be implemented by upgrading any closed-set segmentation model with dense estimates of dataset posterior and unnormalized data likelihood. The resulting dense hybrid open-set models require negative training images that can be sampled from an auxiliary negative dataset, from a jointly trained generative model, or from a mixture of both sources. We evaluate our contributions on benchmarks for dense anomaly detection and open-set segmentation. The experiments reveal strong open-set performance in spite of negligible computational overhead.
Code (1)
Tasks
Anomaly DetectionSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Real time dense anomaly detection by learning on synthetic negative data
Most approaches to dense anomaly detection rely on generative modeling or on discriminative methods that train with negative data. We consider a recent hybrid method that optimizes the same shared representation accordin…
Anomaly DetectionDenseHybrid: Hybrid Anomaly Detection for Dense Open-set Recognition
Anomaly detection can be conceived either through generative modelling of regular training data or by discriminating with respect to negative training data. These two approaches exhibit different failure modes. Consequen…
Anomaly DetectionOpen Set LearningScene SegmentationSemantic SegmentationSynthetic data enables faster annotation and robust segmentation for multi-object grasping in clutter
Object recognition and object pose estimation in robotic grasping continue to be significant challenges, since building a labelled dataset can be time consuming and financially costly in terms of data collection and anno…
Dataset GenerationImage SegmentationObjectObject Recognition+6Assessment of Using Synthetic Data in Brain Tumor Segmentation
Manual brain tumor segmentation from MRI scans is challenging due to tumor heterogeneity, scarcity of annotated data, and class imbalance in medical imaging datasets. Synthetic data generated by generative models has the…
Brain Tumor SegmentationScaling up Image Segmentation across Data and Tasks
Traditional segmentation models, while effective in isolated tasks, often fail to generalize to more complex and open-ended segmentation problems, such as free-form, open-vocabulary, and in-the-wild scenarios. To bri…
DiversityImage SegmentationSegmentationSemantic Segmentation