paper-with-me

Papers

Predicting Foreground Object Ambiguity and Efficiently Crowdsourcing the Segmentation(s)

2017-04-30 · Danna Gurari, Kun He, Bo Xiong, Jianming Zhang, Mehrnoosh Sameki, Suyog Dutt Jain, Stan Sclaroff, Margrit Betke, Kristen Grauman

We propose the ambiguity problem for the foreground object segmentation task and motivate the importance of estimating and accounting for this ambiguity when designing vision systems. Specifically, we distinguish between images which lead multiple annotators to segment different foreground objects (ambiguous) versus minor inter-annotator differences of the same object. Taking images from eight widely used datasets, we crowdsource labeling the images as "ambiguous" or "not ambiguous" to segment in order to construct a new dataset we call STATIC. Using STATIC, we develop a system that automatically predicts which images are ambiguous. Experiments demonstrate the advantage of our prediction system over existing saliency-based methods on images from vision benchmarks and images taken by blind people who are trying to recognize objects in their environment. Finally, we introduce a crowdsourcing system to achieve cost savings for collecting the diversity of all valid "ground truth" foreground object segmentations by collecting extra segmentations only when ambiguity is expected. Experiments show our system eliminates up to 47% of human effort compared to existing crowdsourcing methods with no loss in capturing the diversity of ground truths.

📄 PDF Abstract BibTeX arXiv:1705.00366

Code (0)

등록된 구현이 없습니다.

Tasks

DiversityObjectSemantic Segmentationvalid

Similar Papers 제목 키워드 기반

Learning Ambiguity from Crowd Sequential Annotations

2023-01-04 · Xiaolei Lu

Most crowdsourcing learning methods treat disagreement between annotators as noisy labelings while inter-disagreement among experts is often a good indicator for the ambiguity and uncertainty that is inherent in natural …

NERPOSPOS Tagging

Embracing Ambiguity: A Comparison of Annotation Methodologies for Crowdsourcing Word Sense Labels

2013-06-01 · NAACL 2013 6 · David Jurgens
Word Sense Disambiguation

FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstruction

2026-01-26 · Wei Cao, Hao Zhang, Fengrui Tian, Yulun Wu 외 arxiv

Camera redirection aims to replay a dynamic scene from a single monocular video under a user-specified camera trajectory. However, large-angle redirection is inherently ill-posed: a monocular video captures only a narrow…

Visual GroundingVideo GenerationPoint Clouds

CrowdMOT: Crowdsourcing Strategies for Tracking Multiple Objects in Videos

2020-09-29 · Samreen Anjum, Chi Lin, Danna Gurari

Crowdsourcing is a valuable approach for tracking objects in videos in a more scalable manner than possible with domain experts. However, existing frameworks do not produce high quality results with non-expert crowdworke…

Diversity

Crowdsourcing Ground Truth for Medical Relation Extraction

2017-01-09 · Anca Dumitrache, Lora Aroyo, Chris Welty

Cognitive computing systems require human labeled data for evaluation, and often for training. The standard practice used in gathering this data minimizes disagreement between annotators, and we have found this results i…

Medical Relation ExtractionRelationRelation Extraction