Quality Control for Crowdsourced Bilingual Dictionary in Low-Resource Languages
In conventional bilingual dictionary creation by using crowdsourcing, the main method is to ask multiple workers to translate the same words or sentences and take a majority vote. However, when this method is applied to the creation of bilingual dictionaries for low-resource languages with few speakers, many low-quality workers are expected to participate in the majority voting, which makes it difficult to maintain the quality of the evaluation by the majority voting. Therefore, we apply an effective aggregation method using a hyper question, which is a set of single questions, for quality control. Furthermore, to select high-quality workers, we design a task-allocation method based on the reliability of workers which is evaluated by their work results.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Mining Bilingual Word Pairs from Comparable Corpus using Apache Spark Framework
Bilingual dictionaries are essential resources in many areas of natural language processing tasks, but resource-scarce and less popular language pairs rarely have such. Efficient automatic methods for inducting bilingual…
Machine TranslationNMTTranslationCross-lingual Transfer for Text Classification with Dictionary-based Heterogeneous Graph
In cross-lingual text classification, it is required that task-specific training data in high-resource source languages are available, where the task is identical to that of a low-resource target language. However, colle…
Cross-Lingual TransferGraph Neural Networktext-classificationText Classification+1Dict-NMT: Bilingual Dictionary based NMT for Extremely Low Resource Languages
Neural Machine Translation (NMT) models have been effective on large bilingual datasets. However, the existing methods and techniques show that the model's performance is highly dependent on the number of examples in tra…
Machine TranslationNMTTranslationDict-NMT: Bilingual Dictionary based NMT for Extremely Low Resource Languages
Neural Machine Translation (NMT) models have been effective on large bilingual datasets. However, the existing methods and techniques show that the model's performance is highly dependent on the number of examples in tra…
Machine TranslationNMTTranslationAutomatically Creating a Large Number of New Bilingual Dictionaries
This paper proposes approaches to automatically create a large number of new bilingual dictionaries for low-resource languages, especially resource-poor and endangered languages, from a single input bilingual dictionary.…