Overview of the Wikidata Vandalism Detection Task at WSDM Cup 2017

2017-12-16 · Heindorf Stefan, Potthast Martin, Engels Gregor, Stein Benno

We report on the Wikidata vandalism detection task at the WSDM Cup 2017. The task received five submissions for which this paper describes their evaluation and a comparison to state of the art baselines. Unlike previous work, we recast Wikidata vandalism detection as an online learning problem, requiring participant software to predict vandalism in near real-time. The best-performing approach achieves a ROC-AUC of 0.947 at a PR-AUC of 0.458. In particular, this task was organized as a software submission task: to maximize reproducibility as well as to foster future research and development on this task, the participants were asked to submit their working software to the TIRA experimentation platform along with the source code for open source release.

📄 PDF Abstract BibTeX arXiv:1712.05956

Code (0)

등록된 구현이 없습니다.

Ensemble Models for Detecting Wikidata Vandalism with Stacking - Team Honeyberry Vandalism Detector at WSDM Cup 2017

2017-12-19 · Yamazaki Tomoya Yahoo Japan Corporation, Sasaki Mei Yahoo Japan Corporation, Murakami Naoya Yahoo Japan Corporation, Makabe Takuya Yahoo Japan Corporation 외

The WSDM Cup 2017 is a binary classification task for classifying Wikidata revisions into vandalism and non-vandalism. This paper describes our method using some machine learning techniques such as under-sampling, featur…

BIG-bench Machine Learning Binary Classification feature selection

Wikidata Vandalism Detection - The Loganberry Vandalism Detector at WSDM Cup 2017

2017-12-19 · Zhu Qi University of Illinois Urbana-Champaign, Ng Hongwei University of Illinois Urbana-Champaign, Liu Liyuan University of Illinois Urbana-Champaign, Ji Ziwei University of Illinois Urbana-Champaign 외

Wikidata is the new, large-scale knowledge base of the Wikimedia Foundation. As it can be edited by anyone, entries frequently get vandalized, leading to the possibility that it might spread of falsified information if s…

Proceedings of the WSDM Cup 2017: Vandalism Detection and Triple Scoring

2017-12-27 · Potthast Martin, Heindorf Stefan, Bast Hannah

The WSDM Cup 2017 was a data mining challenge held in conjunction with the 10th International Conference on Web Search and Data Mining (WSDM). It addressed key challenges of knowledge bases today: quality assurance and e…

A Production Oriented Approach for Vandalism Detection in Wikidata - The Buffaloberry Vandalism Detector at WSDM Cup 2017

2017-12-19 · Crescenzi Rafael Austral University, Fernandez Marcelo Austral University, Calabria Federico A. Garcia Austral University, Albani Pablo Austral University 외

Wikidata is a free and open knowledge base from the Wikimedia Foundation, that not only acts as a central storage of structured data for other projects of the organization, but also for a growing array of information sys…

Misinformation

Large-Scale Vandalism Detection with Linear Classifiers - The Conkerberry Vandalism Detector at WSDM Cup 2017

2017-12-19 · Grigorev Alexey Searchmetrics GmbH

Nowadays many artificial intelligence systems rely on knowledge bases for enriching the information they process. Such Knowledge Bases are usually difficult to obtain and therefore they are crowdsourced: they are availab…