Does SAM dream of EIG? Characterizing Interactive Segmenter Performance using Expected Information Gain
We introduce an assessment procedure for interactive segmentation models. Based on concepts from Bayesian Experimental Design, the procedure measures a model's understanding of point prompts and their correspondence with the desired segmentation mask. We show that Oracle Dice index measurements are insensitive or even misleading in measuring this property. We demonstrate the use of the proposed procedure on three interactive segmentation models and subsets of two large image segmentation datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Experimental DesignImage SegmentationInteractive SegmentationSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
A large corpus of lucid and non-lucid dream reports
All varieties of dreaming remain a mystery. Lucid dreams in particular, or those characterized by awareness of the dream, are notoriously difficult to study. Their scarce prevalence and resistance to deliberate induction…
AttaCut: A Fast and Accurate Neural Thai Word Segmenter
Word segmentation is a fundamental pre-processing step for Thai Natural Language Processing. The current off-the-shelf solutions are not benchmarked consistently, so it is difficult to compare their trade-offs. We conduc…
Thai Word SegmentationA dynamic interactive learning framework for automated 3D medical image segmentation
Many deep learning based automated medical image segmentation systems, in reality, face difficulties in deployment due to the cost of massive data annotation and high latency in model iteration. We propose a dynamic inte…
Image RegistrationImage SegmentationInteractive SegmentationKnowledge Distillation+3Extending Automatic Discourse Segmentation for Texts in Spanish to Catalan
At present, automatic discourse analysis is a relevant research topic in the field of NLP. However, discourse is one of the phenomena most difficult to process. Although discourse parsers have been already developed for …
Discourse SegmentationvalidGradient-free activation maximization for identifying effective stimuli
A fundamental question for understanding brain function is what types of stimuli drive neurons to fire. In visual neuroscience, this question has also been posted as characterizing the receptive field of a neuron. The se…