paper-with-me

Papers

Candidate Labeling for Crowd Learning

2018-04-26 · Iker Beñaran-Muñoz, Jerónimo Hernández-González, Aritz Pérez

Crowdsourcing has become very popular among the machine learning community as a way to obtain labels that allow a ground truth to be estimated for a given dataset. In most of the approaches that use crowdsourced labels, annotators are asked to provide, for each presented instance, a single class label. Such a request could be inefficient, that is, considering that the labelers may not be experts, that way to proceed could fail to take real advantage of the knowledge of the labelers. In this paper, the use of candidate labeling for crowd learning is proposed, where the annotators may provide more than a single label per instance to try not to miss the real label. The main hypothesis is that, by allowing candidate labeling, knowledge can be extracted from the labelers more efficiently by than in the standard crowd learning scenario. Empirical evidence which supports that hypothesis is presented.

📄 PDF Abstract BibTeX arXiv:1804.10023

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Modeling sequential annotations for sequence labeling with crowds

2022-09-20 · Xiaolei Lu, Tommy W. S. Chow

Crowd sequential annotations can be an efficient and cost-effective way to build large datasets for sequence labeling. Different from tagging independent instances, for crowd sequential annotations the quality of label s…

valid

BUOCA: Budget-Optimized Crowd Worker Allocation

2019-01-11 · Mehrnoosh Sameki, Sha Lai, Kate K. Mays, Lei Guo 외

Due to concerns about human error in crowdsourcing, it is standard practice to collect labels for the same data point from multiple internet workers. We here show that the resulting budget can be used more effectively wi…

Crowdsourced Collective Entity Resolution with Relational Match Propagation

2020-02-21 · Jiacheng Huang, Wei Hu, Zhifeng Bao, Yuzhong Qu

Knowledge bases (KBs) store rich yet heterogeneous entities and facts. Entity resolution (ER) aims to identify entities in KBs which refer to the same real-world object. Recent studies have shown significant benefits of …

AttributeEntity ResolutionQuestion Selection

Dynamic Allocation of Crowd Contributions for Sentiment Analysis during the 2016 U.S. Presidential Election

2016-08-31 · Mehrnoosh Sameki, Mattia Gentil, Kate K. Mays, Lei Guo 외

Opinions about the 2016 U.S. Presidential Candidates have been expressed in millions of tweets that are challenging to analyze automatically. Crowdsourcing the analysis of political tweets effectively is also difficult, …

Sentiment Analysis

Reducing Spatial Labeling Redundancy for Semi-supervised Crowd Counting

2021-08-06 · Yongtuo Liu, Sucheng Ren, Liangyu Chai, Hanjie Wu 외

Labeling is onerous for crowd counting as it should annotate each individual in crowd images. Recently, several methods have been proposed for semi-supervised crowd counting to reduce the labeling efforts. Given a limite…

Crowd Counting