Back to Basics for Monolingual Alignment: Exploiting Word Similarity and Contextual Evidence
We present a simple, easy-to-replicate monolingual aligner that demonstrates state-of-the-art performance while relying on almost no supervision and a very small number of external resources. Based on the hypothesis that words with similar meanings represent potential pairs for alignment if located in similar contexts, we propose a system that operates by finding such pairs. In two intrinsic evaluations on alignment test data, our system achieves F1 scores of 88{--}92{\%}, demonstrating 1{--}3{\%} absolute improvement over the previous best system. Moreover, in two extrinsic evaluations our aligner outperforms existing aligners, and even a naive application of the aligner approaches state-of-the-art performance in each extrinsic task.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language InferenceQuestion AnsweringText SummarizationWord SimilaritySimilar Papers 제목 키워드 기반
Neural semi-Markov CRF for Monolingual Word Alignment
Monolingual word alignment is important for studying fine-grained editing operations (i.e., deletion, addition, and substitution) in text-to-text generation tasks, such as paraphrase generation, text simplification, neut…
Paraphrase GenerationSentenceSentence-Pair ClassificationText Generation+2English-Malay Cross-Lingual Embedding Alignment using Bilingual Lexicon Augmentation
As high-quality Malay language resources are still a scarcity, cross lingual word embeddings make it possible for richer English resources to be leveraged for downstream Malay text classification tasks. This paper focuse…
Cross-Lingual Word EmbeddingsMachine Translationtext-classificationText Classification+1SAPPHIRE: Simple Aligner for Phrasal Paraphrase with Hierarchical Representation
We present SAPPHIRE, a Simple Aligner for Phrasal Paraphrase with HIerarchical REpresentation. Monolingual phrase alignment is a fundamental problem in natural language understanding and also a crucial technique in vario…
Natural Language InferenceNatural Language UnderstandingSemantic Textual SimilarityWord EmbeddingsUnsupervised Word Mapping Using Structural Similarities in Monolingual Embeddings
Most existing methods for automatic bilingual dictionary induction rely on prior alignments between the source and target languages, such as parallel corpora or seed dictionaries. For many language pairs, such supervised…
Word EmbeddingsUsing Word Vectors to Improve Word Alignments for Low Resource Machine Translation
We present a method for improving word alignments using word similarities. This method is based on encouraging common alignment links between semantically similar words. We use word vectors trained on monolingual data to…
Machine TranslationMorphological AnalysisTranslationWord Alignment