Annotated Corpora for Word Alignment between Japanese and English and its Evaluation with MAP-based Word Aligner
This paper presents two annotated corpora for word alignment between Japanese and English. We annotated on top of the IWSLT-2006 and the NTCIR-8 corpora. The IWSLT-2006 corpus is in the domain of travel conversation while the NTCIR-8 corpus is in the domain of patent. We annotated the first 500 sentence pairs from the IWSLT-2006 corpus and the first 100 sentence pairs from the NTCIR-8 corpus. After mentioned the annotation guideline, we present two evaluation algorithms how to use such hand-annotated corpora: although one is a well-known algorithm for word alignment researchers, one is novel which intends to evaluate a MAP-based word aligner of Okita et al. (2010b).
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationSentenceWord AlignmentSimilar Papers 제목 키워드 기반
Building Large-Scale Japanese Pronunciation-Annotated Corpora for Reading Heteronymous Logograms
Although screen readers enable visually impaired people to read written text via speech, the ambiguities in pronunciations of heteronyms cause wrong reading, which has a serious impact on the text understanding. Especial…
SentenceOriginal-Transcribed Text Alignment for Manyosyu Written by Old Japanese Language
We are constructing an annotated diachronic corpora of the Japanese language. In part of thiswork, we construct a corpus of Manyosyu, which is an old Japanese poetry anthology. In thispaper, we describe how to align the …
Machine TranslationTranslationWikification for Scriptio Continua
The fact that Japanese employs scriptio continua, or a writing system without spaces, complicates the first step of an NLP pipeline. Word segmentation is widely used in Japanese language processing, and lexical knowledge…
SegmentationA Japanese Word Dependency Corpus
In this paper, we present a corpus annotated with dependency relationships in Japanese. It contains about 30 thousand sentences in various domains. Six domains in Balanced Corpus of Contemporary Written Japanese have par…
ArticlesDependency ParsingMachine TranslationSentence+1Line-a-line: A Tool for Annotating Word-Alignments
We here describe line-a-line, a web-based tool for manual annotation of word-alignments in sentence-aligned parallel corpora. The graphical user interface, which builds on a design template from the Jigsaw system for inv…
Multilingual Word EmbeddingsSentenceWord AlignmentWord Embeddings