Inter-Weighted Alignment Network for Sentence Pair Modeling
Sentence pair modeling is a crucial problem in the field of natural language processing. In this paper, we propose a model to measure the similarity of a sentence pair focusing on the interaction information. We utilize the word level similarity matrix to discover fine-grained alignment of two sentences. It should be emphasized that each word in a sentence has a different importance from the perspective of semantic composition, so we exploit two novel and efficient strategies to explicitly calculate a weight for each word. Although the proposed model only use a sequential LSTM for sentence modeling without any external resource such as syntactic parser tree and additional lexicon features, experimental results show that our model achieves state-of-the-art performance on three datasets of two tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationNatural Language InferenceParaphrase IdentificationQuestion AnsweringRelation ClassificationSemantic CompositionSemantic Textual SimilaritySentenceSentence Pair ModelingWord EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment
Word alignment which aims to extract lexicon translation equivalents between source and target sentences, serves as a fundamental tool for natural language processing. Recent studies in this area have yielded substantial…
Language ModelingLanguage ModellingSentenceTranslation+1DSim, a Danish Parallel Corpus for Text Simplification
We present DSim, a new sentence aligned Danish monolingual parallel corpus extracted from 3701 pairs of news telegrams and corresponding professionally simplified short news articles. The corpus is intended for building …
ArticlesMachine TranslationSentenceText Generation+1Approximating solution structure of the Weighted Sentence Alignment problem
We study the complexity of approximating solution structure of the bijective weighted sentence alignment problem of DeNero and Klein (2008). In particular, we consider the complexity of finding an alignment that has a si…
SentenceSongMASS: Automatic Song Writing with Pre-training and Alignment Constraint
Automatic song writing aims to compose a song (lyric and/or melody) by machine, which is an interesting topic in both academia and industry. In automatic song writing, lyric-to-melody generation and melody-to-lyric gener…
SentenceOmniAlign: A Unified Multilingual Aligner for Word and Sentence Alignment
Cross-lingual sequence alignment is fundamental for building and exploiting parallel corpora, spanning mappings from documents and sentences down to words and subwords. Existing tools, however, typically specialize in a …
Long-Context UnderstandingSelf-Supervised LearningWord Alignment