Context-Aware Interaction Network for Question Matching
Impressive milestones have been achieved in text matching by adopting a cross-attention mechanism to capture pertinent semantic connections between two sentence representations. However, regular cross-attention focuses on word-level links between the two input sequences, neglecting the importance of contextual information. We propose a context-aware interaction network (COIN) to properly align two sequences and infer their semantic relationship. Specifically, each interaction block includes (1) a context-aware cross-attention mechanism to effectively integrate contextual information when aligning two sequences, and (2) a gate fusion layer to flexibly interpolate aligned representations. We apply multiple stacked interaction blocks to produce alignments at different levels and gradually refine the attention results. Experiments on two question matching datasets and detailed analyses demonstrate the effectiveness of our model.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceText MatchingSimilar Papers 제목 키워드 기반
PG-GSQL: Pointer-Generator Network with Guide Decoding for Cross-Domain Context-Dependent Text-to-SQL Generation
Text-to-SQL is a task of translating utterances to SQL queries, and most existing neural approaches of text-to-SQL focus on the cross-domain context-independent generation task. We pay close attention to the cross-domain…
DecoderText to SQLText-To-SQLA Hybrid Approach of Deep Semantic Matching and Deep Rank for Context Aware Question Answer System
DCMN+: Dual Co-Matching Network for Multi-choice Reading Comprehension
Multi-choice reading comprehension is a challenging task to select an answer from a set of candidate options when given passage and question. Previous approaches usually only calculate question-aware passage representati…
Reading ComprehensionSentenceAnswer-focused and Position-aware Neural Question Generation
In this paper, we focus on the problem of question generation (QG). Recent neural network-based approaches employ the sequence-to-sequence model which takes an answer and its context as input and generates a relevant que…
Machine Reading ComprehensionPositionQuestion AnsweringQuestion Generation+2Improving Question Generation with Sentence-level Semantic Matching and Answer Position Inferring
Taking an answer and its context as input, sequence-to-sequence models have made considerable progress on question generation. However, we observe that these approaches often generate wrong question words or keywords and…
DecoderPositionQuestion GenerationQuestion-Generation+1