Neural Network-based Word Alignment through Score Aggregation
We present a simple neural network for word alignment that builds source and target word window representations to compute alignment scores for sentence pairs. To enable unsupervised training, we use an aggregation operation that summarizes the alignment scores for a given target word. A soft-margin objective increases scores for true target words while decreasing scores for target words that are not present. Compared to the popular Fast Align model, our approach improves alignment accuracy by 7 AER on English-Czech, by 6 AER on Romanian-English and by 1.7 AER on English-French alignment.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceWord AlignmentSimilar Papers 제목 키워드 기반
Subword Sampling for Low Resource Word Alignment
Annotation projection is an important area in NLP that can greatly contribute to creating language resources for low-resource languages. Word alignment plays a key role in this setting. However, most of the existing word…
Bayesian OptimizationMachine TranslationWord AlignmentLeveraging Neural Machine Translation for Word Alignment
The most common tools for word-alignment rely on a large amount of parallel sentences, which are then usually processed according to one of the IBM model algorithms. The training data is, however, the same as for machine…
DecoderMachine TranslationNMTSentence+2Sentence level estimation of psycholinguistic norms using joint multidimensional annotations
Psycholinguistic normatives represent various affective and mental constructs using numeric scores and are used in a variety of applications in natural language processing. They are commonly used at the sentence level, t…
SentenceALMA: Alignment with Minimal Annotation
Recent approaches to large language model (LLM) alignment typically require millions of human annotations or rely on external aligned models for synthetic data generation. This paper introduces ALMA: Alignment with Minim…
Few-Shot LearningLanguage ModelingLanguage ModellingLarge Language Model+2Alignment-based reordering for SMT
We present a method for improving word alignment quality for phrase-based statistical machine translation by reordering the source text according to the target word order suggested by an initial word alignment. The reord…
Machine TranslationPart-Of-Speech TaggingTranslationWord Alignment