Deriving Consensus for Multi-Parallel Corpora: an English Bible Study
What can you do with multiple noisy versions of the same text? We present a method which generates a single consensus between multi-parallel corpora. By maximizing a function of linguistic features between word pairs, we jointly learn a single corpus-wide multiway alignment: a consensus between 27 versions of the English Bible. We additionally produce English paraphrases, word-level distributions of tags, and consensus dependency parses. Our method is language independent and applicable to any multi-parallel corpora. Given the Bible{'}s unique role as alignable bitext for over 800 of the world{'}s languages, this consensus alignment and resulting resources offer value for multilingual annotation projection, and also shed potential insights into the Bible itself.
Code (1)
Tasks
Machine TranslationSimilar Papers 제목 키워드 기반
Deriving a PropBank Corpus from Parallel FrameNet and UD Corpora
We propose an approach for generating an accurate and consistent PropBank-annotated corpus, given a FrameNet-annotated corpus which has an underlying dependency annotation layer, namely, a parallel Universal Dependencies…
Language Agnostic Multilingual Information Retrieval with Contrastive Learning
Multilingual information retrieval (IR) is challenging since annotated training data is costly to obtain in many languages. We present an effective method to train multilingual IR systems when only English IR training da…
Contrastive LearningCross-Lingual TransferInformation RetrievalPretrained Multilingual Language Models+3OdiEnCorp 2.0: Odia-English Parallel Corpus for Machine Translation
The preparation of parallel corpora is a challenging task, particularly for languages that suffer from under-representation in the digital world. In a multi-lingual country like India, the need for such parallel corpora …
Machine TranslationNMTOptical Character RecognitionOptical Character Recognition (OCR)+1Collaboratively Annotating Multilingual Parallel Corpora in the Biomedical Domain---some MANTRAs
The coverage of multilingual biomedical resources is high for the English language, yet sparse for non-English languages―an observation which holds for seemingly well-resourced, yet still dramatically low-resourced one…
Named Entity Recognition (NER)TranslationzNLP: Identifying Parallel Sentences in Chinese-English Comparable Corpora
This paper describes the zNLP system for the BUCC 2017 shared task. Our system identifies parallel sentence pairs in Chinese-English comparable corpora by translating word-by-word Chinese sentences into English, using th…
Machine TranslationSentence