Large-scale Word Alignment Using Soft Dependency Cohesion Constraints
Dependency cohesion refers to the observation that phrases dominated by disjoint dependency subtrees in the source language generally do not overlap in the target language. It has been verified to be a useful constraint for word alignment. However, previous work either treats this as a hard constraint or uses it as a feature in discriminative models, which is ineffective for large-scale tasks. In this paper, we take dependency cohesion as a soft constraint, and integrate it into a generative model for large-scale word alignment experiments. We also propose an approximate EM algorithm and a Gibbs sampling algorithm to estimate model parameters in an unsupervised manner. Experiments on large-scale Chinese-English translation tasks demonstrate that our model achieves improvements in both alignment quality and translation quality.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationTranslationWord AlignmentSimilar Papers 제목 키워드 기반
SWIFT Aligner, A Multifunctional Tool for Parallel Corpora: Visualization, Word Alignment, and (Morpho)-Syntactic Cross-Language Transfer
It is well known that word aligned parallel corpora are valuable linguistic resources. Since many factors affect automatic alignment quality, manual post-editing may be required in some applications. While there are seve…
Machine TranslationWord AlignmentWord Sense DisambiguationCross-Lingual Dependency Parsing Using Code-Mixed TreeBank
Treebank translation is a promising method for cross-lingual transfer of syntactic dependency knowledge. The basic idea is to map dependency arcs from a source treebank to its target translation according to word alignme…
Cross-Lingual TransferCross-Lingual Word EmbeddingsDependency ParsingTranslation+1Dependency Forest based Word Alignment
The Aligned Multimodal Movie Treebank: An audio, video, dependency-parse treebank
Treebanks have traditionally included only text and were derived from written sources such as newspapers or the web. We introduce the Aligned Multimodal Movie Treebank, an English language treebank derived from naturalis…
Exploiting catenae in a parallel treebank alignment
This paper aims to introduce the issues related to the syntactic alignment of a dependency-based multilingual parallel treebank, ParTUT. Our approach to the task starts from a lexical mapping and then attempts to expand …
Translation