paper-with-me

홈 › Papers

Use of a Citizen Science Platform for the Creation of a Language Resource to Study Bias in Language Models for French: A Case Study

2022-06-01 · NIDCP (LREC) 2022 6 · Karën Fort, Aurélie Névéol, Yoann Dupont, Julien Bezançon

There is a growing interest in the evaluation of bias, fairness and social impact of Natural Language Processing models and tools. However, little resources are available for this task in languages other than English. Translation of resources originally developed for English is a promising research direction. However, there is also a need for complementing translated resources by newly sourced resources in the original languages and social contexts studied. In order to collect a language resource for the study of biases in Language Models for French, we decided to resort to citizen science. We created three tasks on the LanguageARC citizen science platform to assist with the translation of an existing resource from English into French as well as the collection of complementary resources in native French. We successfully collected data for all three tasks from a total of 102 volunteer participants. Participants from different parts of the world contributed and we noted that although calls sent to mailing lists had a positive impact on participation, some participants pointed barriers to contributions due to the collection platform.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessTranslation

Similar Papers 제목 키워드 기반

LanguageARC: Developing Language Resources Through Citizen Linguistics

2020-05-01 · LREC 2020 5 · James Fiumara, Christopher Cieri, Jonathan Wright, Mark Liberman

This paper introduces the citizen science platform, LanguageARC, developed within the NIEUW (Novel Incentives and Workflows) project supported by the National Science Foundation under Grant No. 1730377. LanguageARC is a …

ARC

Developing Language Resources with Citizen Linguistics in Austria -- A Case Study

2020-05-01 · LREC 2020 5 · Barbara Heinisch

Language resources are a major ingredient for the advancement of language technologies. Citizen linguistics can help to create language resources and annotate language resources, not only for the improvement of language …

Machine Translation

Network Analysis of the iNaturalist Citizen Science Community

2023-10-16 · Yu Lu Liu, Thomas Jiralerspong

In recent years, citizen science has become a larger and larger part of the scientific community. Its ability to crowd source data and expertise from thousands of citizen scientists makes it invaluable. Despite the field…

Link Prediction

Speaking Outside the Box: Exploring the Benefits of Unconstrained Input in Crowdsourcing and Citizen Science Platforms

2020-05-01 · LREC 2020 5 · Jon Chamberlain, Udo Kruschwitz, Massimo Poesio

Crowdsourcing approaches provide a difficult design challenge for developers. There is a trade-off between the efficiency of the task to be done and the reward given to the user for participating, whether it be altruism,…

The Influence of Intrinsic and Extrinsic Motivation on the Creation of Language Resources in a Citizen Linguistics Project about Lexicography

2022-06-01 · NIDCP (LREC) 2022 6 · Barbara Heinisch

In the field of citizen linguistics, various initiatives are aimed at the creation of language resources by members of the public. To recruit and retain these participants different incentives informed by different motiv…